Oct 31 12:56:52.096699 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 31 12:56:52.096711 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 31 12:56:52.096718 ip-10-0-134-236 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 31 12:56:52.096969 ip-10-0-134-236 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 31 12:57:03.531889 ip-10-0-134-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 31 12:57:03.531907 ip-10-0-134-236 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 26e034afe3d346219da37cfc51a16a14 --
Oct 31 12:58:57.387967 ip-10-0-134-236 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 12:58:57.785238 ip-10-0-134-236 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:58:57.785238 ip-10-0-134-236 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 12:58:57.785238 ip-10-0-134-236 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:58:57.785238 ip-10-0-134-236 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:58:57.791078 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.790987    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.791078 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791073    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.791078 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791078    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.791078 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791086    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791092    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791097    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791102    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791107    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791110    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791114    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791117    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791121    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791125    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791129    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791133    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791137    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791141    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791146    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791180    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791186    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791192    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791197    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791225    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.791335 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791231    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791236    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791240    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791245    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791249    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791253    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791258    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791262    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791266    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791271    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791275    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791279    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791284    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791288    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791295    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791300    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791305    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791309    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791313    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791317    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.792142 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791322    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791326    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791330    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791335    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791341    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791345    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791350    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791354    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791358    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791363    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791367    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791371    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791375    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791380    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791384    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791388    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791392    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791396    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791401    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791405    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.792979 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791409    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791424    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791428    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791432    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791436    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791440    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791446    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791451    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791455    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791459    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791464    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791468    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791472    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791476    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791480    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791487    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791493    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791498    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791503    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.793850 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791507    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791511    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791515    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791519    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791523    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791528    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791532    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791536    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791540    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791544    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791548    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791552    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791556    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791561    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791565    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791569    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791574    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791578    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791582    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791588    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.794681 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791592    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791596    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791601    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.791619    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792901    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792911    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792917    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792922    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792926    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792930    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792934    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792940    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792944    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792949    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792954    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792958    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792962    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792966    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792970    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792974    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.795265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792979    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792983    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792988    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792991    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792995    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.792999    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793004    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793008    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793013    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793017    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793021    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793027    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793032    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793038    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793042    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793047    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793051    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793055    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793059    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.795774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793064    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793068    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793072    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793076    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793080    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793085    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793090    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793094    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793098    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793103    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793107    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793111    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793115    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793120    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793124    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793128    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793132    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793136    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793141    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793145    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.796224 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793149    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793153    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793158    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793162    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793168    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793172    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793177    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793181    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793185    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793189    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793193    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793198    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793202    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793209    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793215    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793219    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793224    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793228    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793234    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793239    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.796943 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793244    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793249    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793253    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793257    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793261    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793266    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793270    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793275    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793280    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793285    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793289    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793294    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793298    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793302    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793306    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793312    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793317    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793321    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793342    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793347    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.797823 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793351    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793355    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793360    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793374    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793378    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793382    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793386    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793390    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793394    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793398    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.793402    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794260    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794269    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794274    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794279    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794283    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794288    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794292    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794298    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794303    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.798309 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794307    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794311    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794315    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794320    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794324    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794329    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794333    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794337    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794342    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794346    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794351    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794355    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794359    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794363    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794368    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794372    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794377    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794381    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794387    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.798797 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794393    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794397    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794402    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794407    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794413    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794417    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794421    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794428    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794433    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794437    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794441    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794445    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794450    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794454    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794458    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794462    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794467    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794471    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794475    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.799265 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794480    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794484    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794488    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794493    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794498    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794502    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794506    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794510    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794514    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794518    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794523    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794526    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794531    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794535    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794539    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794544    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794548    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794552    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794557    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794562    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.799739 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794568    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794572    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794576    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794580    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794585    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794589    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794593    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794597    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794619    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794624    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794629    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794633    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794637    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794641    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794646    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794650    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794678    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794684    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794690    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794695    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.800207 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794699    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794703    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794707    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794714    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794720    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794726    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794730    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794735    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794739    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794744    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794748    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794754    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794764    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794768    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794773    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794777    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794781    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794787    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.794791    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796444    2584 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 12:58:57.800713 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796468    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796481    2584 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796488    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796495    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796501    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796509    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796516    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796521    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796527    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796532    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796538    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796544    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796549    2584 flags.go:64] FLAG: --cgroup-root=""
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796554    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796559    2584 flags.go:64] FLAG: --client-ca-file=""
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796563    2584 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796568    2584 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796574    2584 flags.go:64] FLAG: --cluster-domain=""
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796578    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796584    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796589    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796594    2584 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796615    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 12:58:57.801186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796622    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796628    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796633    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796638    2584 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796643    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796648    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796653    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796657    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796664    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796670    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796675    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796679    2584 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796684    2584 flags.go:64] FLAG: --enable-server="true"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796689    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796698    2584 flags.go:64] FLAG: --event-burst="100"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796703    2584 flags.go:64] FLAG: --event-qps="50"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796707    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796712    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796716    2584 flags.go:64] FLAG: --eviction-hard=""
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796723    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796728    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796733    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796738    2584 flags.go:64] FLAG: --eviction-soft=""
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796743    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796748    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 12:58:57.801732 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796753    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796757    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796762    2584 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796767    2584 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796771    2584 flags.go:64] FLAG: --feature-gates=""
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796778    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796783    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796789    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796794    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796801    2584 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796806    2584 flags.go:64] FLAG: --help="false"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796810    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796815    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796820    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796825    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796830    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796836    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796841    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796845    2584 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796849    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796854    2584 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796859    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796865    2584 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796869    2584 flags.go:64] FLAG: --kube-reserved=""
Oct 31 12:58:57.802373 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796875    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796879    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796885    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796889    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796894    2584 flags.go:64] FLAG: --lock-file=""
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796898    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796903    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796908    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796917    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796922    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796927    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796931    2584 flags.go:64] FLAG: --logging-format="text"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796936    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796942    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796947    2584 flags.go:64] FLAG: --manifest-url=""
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796951    2584 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796958    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796963    2584 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796970    2584 flags.go:64] FLAG: --max-pods="110"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796976    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796982    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796986    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796991    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.796996    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797001    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 12:58:57.802953 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797005    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797017    2584 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797022    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797028    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797032    2584 flags.go:64] FLAG: --pod-cidr=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797037    2584 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797041    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797046    2584 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797051    2584 flags.go:64] FLAG: --port="10250"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797056    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797062    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0169768e5677c626c"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797067    2584 flags.go:64] FLAG: --qos-reserved=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797072    2584 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797077    2584 flags.go:64] FLAG: --register-node="true"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797082    2584 flags.go:64] FLAG: --register-with-taints=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797088    2584 flags.go:64] FLAG: --registry-burst="10"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797093    2584 flags.go:64] FLAG: --registry-qps="5"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797097    2584 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797102    2584 flags.go:64] FLAG: --reserved-memory=""
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797109    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797114    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797119    2584 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797123    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797128    2584 flags.go:64] FLAG: --runonce="false"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797133    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797138    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797144    2584 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 12:58:57.803922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797149    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797154    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797159    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797164    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797169    2584 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797173    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797178    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797183    2584 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797187    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797193    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797198    2584 flags.go:64] FLAG: --system-cgroups=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797202    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797211    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797216    2584 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797220    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797226    2584 flags.go:64] FLAG: --tls-min-version=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797231    2584 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797236    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797241    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797245    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797250    2584 flags.go:64] FLAG: --v="2"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797257    2584 flags.go:64] FLAG: --version="false"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797263    2584 flags.go:64] FLAG: --vmodule=""
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797270    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797276    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 12:58:57.805058 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797506    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797515    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797520    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797529    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797534    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797538    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797542    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797547    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797552    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797556    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797561    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797565    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797569    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797573    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797577    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797583    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797588    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797592    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797596    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797601    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.806115 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797622    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797627    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797631    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797635    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797639    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797643    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797646    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797649    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797653    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797657    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797661    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797665    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797668    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797670    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797673    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797678    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797681    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797684    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797686    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.807020 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797689    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797693    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797696    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797699    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797701    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797704    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797707    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797709    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797713    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797716    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797719    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797721    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797724    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797727    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797730    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797732    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797735    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797738    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797740    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797743    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.807930 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797745    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797748    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797751    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797753    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797756    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797758    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797761    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797763    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797767    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797770    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797772    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797775    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797777    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797780    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797783    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797786    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797788    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797791    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797794    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.808396 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797796    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797800    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797803    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797805    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797808    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797811    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797813    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797816    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797819    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797823    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797827    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797830    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797833    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797836    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797839    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797842    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797845    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797847    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797850    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.808863 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797853    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797855    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797859    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797862    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797864    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797867    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797870    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797872    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797875    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.797904    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797943    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797948    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797952    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797955    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797958    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.809295 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797963    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797965    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797968    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797970    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797973    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797975    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797978    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797981    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797983    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797986    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797989    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797992    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797994    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.797997    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798000    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798003    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798007    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798010    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798013    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.809674 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798016    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798019    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798021    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798024    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798027    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798029    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798032    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798035    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798038    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798041    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798043    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798046    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798048    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798052    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798055    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798058    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798060    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798063    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798066    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798068    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.810130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798071    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798074    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798076    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798079    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798082    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798084    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798087    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798089    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798092    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798094    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798097    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798100    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798104    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798107    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798109    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798112    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798115    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798117    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798120    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798123    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.810644 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798125    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798135    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798138    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798142    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798146    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798151    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798154    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798158    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798160    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798164    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798166    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798169    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798171    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798174    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798177    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798180    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798182    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798185    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798188    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798190    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.811130 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798193    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798195    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798198    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798200    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798204    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798207    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798210    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798212    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798216    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798218    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798221    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798223    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798226    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798228    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798231    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798234    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798237    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798243    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798245    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798248    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.811621 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798251    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.798254    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.805809    2584 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.805825    2584 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.805844    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.805852    2584 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805939    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805946    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805952    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805958    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805964    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805969    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805974    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805978    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805985    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805991    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.805996    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806001    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806005    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.812106 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806010    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806014    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806019    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806023    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806027    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806032    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806036    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806041    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806045    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806050    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806054    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806058    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806063    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806067    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806071    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806076    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806081    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806085    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806090    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806094    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.812549 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806099    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806104    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806108    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806112    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806116    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806120    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806124    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806128    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806132    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806136    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806141    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806146    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806150    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806155    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806159    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806164    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806168    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806172    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806178    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.813108 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806184    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806190    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806195    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806200    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806204    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806209    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806214    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806218    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806223    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806228    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806232    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806236    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806241    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806246    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806250    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806254    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806259    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806263    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806267    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806271    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.813661 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806275    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806279    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806283    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806288    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806293    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806297    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806301    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806306    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806310    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806314    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806318    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806322    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806328    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806332    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806337    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806341    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806346    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806350    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806354    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806358    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.814227 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806362    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806367    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806372    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806376    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806380    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806384    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806388    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806392    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806396    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806400    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806404    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806409    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806413    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806417    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.806460    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:58:57.815032 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806703    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806713    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806718    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806723    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806727    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806732    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806736    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806740    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806744    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806749    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806753    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806757    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806767    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806772    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806776    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806780    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806785    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806790    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806796    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.815469 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806803    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806808    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806814    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806820    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806825    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806830    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806835    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806839    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806843    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806847    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806852    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806856    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806861    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806865    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806869    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806873    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806877    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806881    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806885    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806890    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.815959 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806894    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806898    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806902    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806907    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806911    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806916    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806921    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806926    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806930    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806934    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806938    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806944    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806949    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806953    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806957    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806961    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806966    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806970    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806974    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.816445 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806979    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806983    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806988    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806992    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.806996    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807000    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807005    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807009    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807013    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807017    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807021    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807025    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807029    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807033    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807037    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807041    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807045    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807049    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807053    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807058    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.816944 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807063    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807067    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807071    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807075    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807080    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807085    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807089    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807093    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807097    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807102    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807106    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807110    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807115    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807119    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807123    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807127    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807131    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807135    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807140    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.817460 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807144    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807149    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807153    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807157    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807161    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807166    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807170    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807174    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807178    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.807224    2584 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807279    2584 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807287    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807295    2584 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807300    2584 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807306    2584 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807310    2584 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:58:57.817927 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807314    2584 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807319    2584 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807323    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807328    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807332    2584 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807336    2584 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807340    2584 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807345    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807349    2584 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807353    2584 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807357    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807361    2584 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807368    2584 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807374    2584 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807379    2584 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807385    2584 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807390    2584 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807396    2584 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807401    2584 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:58:57.818312 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807405    2584 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807410    2584 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807414    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807418    2584 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807422    2584 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807427    2584 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807431    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807435    2584 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807439    2584 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807446    2584 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807450    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807454    2584 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807459    2584 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807463    2584 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807469    2584 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807474    2584 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807478    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807483    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807487    2584 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807492    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:58:57.818774 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807496    2584 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807500    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807504    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807508    2584 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807513    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807517    2584 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807521    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807525    2584 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807528    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807532    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807536    2584 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807539    2584 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807543    2584 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807549    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807553    2584 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807556    2584 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807560    2584 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807564    2584 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807568    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:58:57.819462 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807572    2584 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807576    2584 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807582    2584 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807586    2584 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807591    2584 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807594    2584 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807599    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807624    2584 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807628    2584 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807632    2584 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807637    2584 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807641    2584 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807644    2584 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807647    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807650    2584 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807653    2584 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807656    2584 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807658    2584 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807661    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807665    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:58:57.819933 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807667    2584 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807670    2584 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807672    2584 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807675    2584 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807678    2584 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807681    2584 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807684    2584 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807686    2584 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807689    2584 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807692    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807694    2584 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807697    2584 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807700    2584 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807702    2584 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807707    2584 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807709    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807712    2584 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807715    2584 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807718    2584 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:58:57.820447 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807723    2584 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807726    2584 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:57.807729    2584 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.807790    2584 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.810104    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.810951    2584 server.go:1014] "Starting client certificate rotation"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.811051    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.811105    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.812785    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 12:58:57.820908 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.816091    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 12:58:57.822800 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.822786    2584 log.go:25] "Validated CRI v1 runtime API"
Oct 31 12:58:57.826566 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.826551    2584 log.go:25] "Validated CRI v1 image API"
Oct 31 12:58:57.827436 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.827409    2584 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 12:58:57.832685 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.832657    2584 fs.go:135] Filesystem UUIDs: map[4b4f37a8-6f77-4d4b-946d-67845a58cae4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8fea849b-88d0-4208-bc57-75b29a5c92ff:/dev/nvme0n1p3]
Oct 31 12:58:57.832771 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.832683    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 12:58:57.837477 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.837350    2584 manager.go:217] Machine: {Timestamp:2026-10-31 12:58:57.836121625 +0000 UTC m=+0.335915919 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099981 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28dd06122bd8647f897737f811fa43 SystemUUID:ec28dd06-122b-d864-7f89-7737f811fa43 BootID:26e034af-e3d3-4621-9da3-7cfc51a16a14 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dc:1c:a1:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dc:1c:a1:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:c1:fb:d9:31:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 12:58:57.837477 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.837471    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 12:58:57.837651 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.837575    2584 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 12:58:57.841011 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.840989    2584 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 12:58:57.841148 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.841012    2584 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-236.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 12:58:57.841190 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.841150    2584 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 12:58:57.841190 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.841159    2584 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 12:58:57.841190 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.841181    2584 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 12:58:57.841273 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.841199    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 12:58:57.842318 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.842307    2584 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 12:58:57.848338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.848323    2584 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 12:58:57.848459 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.848449    2584 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 12:58:57.849251 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849240    2584 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 12:58:57.849293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849256    2584 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 12:58:57.849293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849267    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 12:58:57.849293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849275    2584 kubelet.go:405] "Adding apiserver pod source"
Oct 31 12:58:57.849293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849285    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 12:58:57.849660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.849645    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 12:58:57.853560 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.853538    2584 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 12:58:57.854595 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.854575    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 12:58:57.860079 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.860062    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 12:58:57.861129 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861115    2584 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 12:58:57.861192 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861156    2584 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 12:58:57.861345 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861333    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 12:58:57.861411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861355    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 12:58:57.861411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861372    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 12:58:57.861411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861382    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 12:58:57.861411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861392    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 12:58:57.861411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.861402    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 12:58:57.862127 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862116    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 12:58:57.862176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862130    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 12:58:57.862176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862141    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 12:58:57.862176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862151    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 12:58:57.862176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862165    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 12:58:57.862323 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.862178    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 12:58:57.863069 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.863058    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 12:58:57.863121 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.863073    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 12:58:57.867013 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.866997    2584 server.go:1263] "Started kubelet"
Oct 31 12:58:57.867755 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.867271    2584 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 12:58:57.867755 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.867359    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-236.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 12:58:57.867902 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.867688    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 12:58:57.867902 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.867855    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 12:58:57.867868 ip-10-0-134-236 systemd[1]: Started Kubernetes Kubelet.
Oct 31 12:58:57.869440 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.869428    2584 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 12:58:57.871252 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.871236    2584 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 12:58:57.872662 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.872644    2584 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 12:58:57.877486 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.877471    2584 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 12:58:57.877486 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.877480    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 12:58:57.877746 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.877726    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:57.878249 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.878231    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 12:58:57.878376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.878231    2584 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 12:58:57.878480 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.878463    2584 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 12:58:57.880253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.878580    2584 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 12:58:57.880253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.878592    2584 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 12:58:57.881224 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881206    2584 factory.go:153] Registering CRI-O factory
Oct 31 12:58:57.881224 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881226    2584 factory.go:223] Registration of the crio container factory successfully
Oct 31 12:58:57.881353 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881294    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 12:58:57.881353 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881301    2584 factory.go:55] Registering systemd factory
Oct 31 12:58:57.881353 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881308    2584 factory.go:223] Registration of the systemd container factory successfully
Oct 31 12:58:57.881353 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881329    2584 factory.go:103] Registering Raw factory
Oct 31 12:58:57.881353 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.881344    2584 manager.go:1199] Started watching for new ooms in manager
Oct 31 12:58:57.882361 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.882344    2584 manager.go:319] Starting recovery of all containers
Oct 31 12:58:57.889062 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.889034    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-236.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 12:58:57.889174 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.889073    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 31 12:58:57.889762 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.889734    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 12:58:57.892630 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.892584    2584 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-236.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 12:58:57.893093 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.889381    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.us-east-2.compute.internal.18e39eabec704325  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 12:58:57.866965797 +0000 UTC m=+0.366760092,LastTimestamp:2026-10-31 12:58:57.866965797 +0000 UTC m=+0.366760092,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.us-east-2.compute.internal,}"
Oct 31 12:58:57.895693 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.895674    2584 manager.go:324] Recovery completed
Oct 31 12:58:57.897093 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.897070    2584 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 31 12:58:57.900805 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.900791    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:57.902432 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.902414    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:57.902522 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.902450    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:57.902522 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.902466    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:57.903069 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903055    2584 cpu_manager.go:226] "Starting" policy="none"
Oct 31 12:58:57.903069 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903063    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:57.903069 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903068    2584 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 12:58:57.903254 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903088    2584 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 12:58:57.903745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903732    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:57.903798 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903757    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:57.903798 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.903768    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:57.904962 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.904896    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.us-east-2.compute.internal.18e39eabee8d6f97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-236.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 12:58:57.902432151 +0000 UTC m=+0.402226448,LastTimestamp:2026-10-31 12:58:57.902432151 +0000 UTC m=+0.402226448,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.us-east-2.compute.internal,}"
Oct 31 12:58:57.905310 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.905298    2584 policy_none.go:50] "Start"
Oct 31 12:58:57.905374 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.905317    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 12:58:57.905374 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.905330    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 12:58:57.907447 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.907433    2584 policy_none.go:44] "Start"
Oct 31 12:58:57.921080 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.920986    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.us-east-2.compute.internal.18e39eabee8dcdd3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-236.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 12:58:57.902456275 +0000 UTC m=+0.402250572,LastTimestamp:2026-10-31 12:58:57.902456275 +0000 UTC m=+0.402250572,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.us-east-2.compute.internal,}"
Oct 31 12:58:57.924915 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.924892    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5b5mx"
Oct 31 12:58:57.933257 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.933079    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-236.us-east-2.compute.internal.18e39eabee8e08f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-236.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-236.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-236.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 12:58:57.902471408 +0000 UTC m=+0.402265709,LastTimestamp:2026-10-31 12:58:57.902471408 +0000 UTC m=+0.402265709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-236.us-east-2.compute.internal,}"
Oct 31 12:58:57.936341 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.936317    2584 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 12:58:57.938160 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.938142    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5b5mx"
Oct 31 12:58:57.938706 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.938693    2584 manager.go:341] "Starting Device Plugin manager"
Oct 31 12:58:57.938786 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.938727    2584 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 12:58:57.938786 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.938737    2584 server.go:87] "Starting device plugin registration server"
Oct 31 12:58:57.938980 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.938968    2584 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 12:58:57.939011 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.938981    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 12:58:57.939249 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.939052    2584 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 12:58:57.939249 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.939127    2584 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 12:58:57.939249 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.939135    2584 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 12:58:57.939724 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.939691    2584 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 12:58:57.939820 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.939749    2584 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:57.966352 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.957203    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 12:58:57.966352 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.957226    2584 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 12:58:57.966352 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.957246    2584 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 12:58:57.966352 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:57.957275    2584 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 12:58:57.966352 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:57.961501    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:58:58.039206 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.039115    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:58.040171 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.040155    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:58.040253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.040186    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:58.040253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.040200    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:58.040253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.040232    2584 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.051292 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.051266    2584 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.051292 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.051295    2584 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-236.us-east-2.compute.internal\": node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.058166 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.058143    2584 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"]
Oct 31 12:58:58.058301 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.058201    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:58.059047 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.059030    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:58.059105 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.059060    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:58.059105 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.059070    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:58.061207 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061196    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:58.061377 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061355    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.061411 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061398    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:58.061917 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061900    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:58.061917 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061922    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:58.061917 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061924    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:58.061917 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061931    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:58.062196 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061947    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:58.062196 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.061960    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:58.064005 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.063988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.064095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.064017    2584 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:58:58.064676 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.064662    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:58:58.064741 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.064692    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:58:58.064741 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.064705    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:58:58.079480 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.079459    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.079561 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.079484    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.079561 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.079500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.080725 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.080707    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.089147 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.089129    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.091148 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.091134    2584 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180060    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180285 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180285 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180110    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180285 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180117    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.180285 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.180155    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.181082 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.181065    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.281567 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.281536    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.381955 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.381907    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.393986 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.393951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.397403 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.397380    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.482331 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.482295    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.585409 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.585361    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.686225 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.686104    2584 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:58:58.752629 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.752594    2584 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:58:58.779742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.779710    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.793036 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.793000    2584 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:58:58.797379 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.797356    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:58:58.798560 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.798545    2584 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:58:58.809494 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.809475    2584 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:58:58.810626 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.810572    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 12:58:58.810776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.810751    2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 12:58:58.810830 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.810794    2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 12:58:58.810830 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.810795    2584 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 12:58:58.849820 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.849782    2584 apiserver.go:52] "Watching apiserver"
Oct 31 12:58:58.875214 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.875183    2584 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 12:58:58.875501 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.875481    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6wvpk","openshift-network-diagnostics/network-check-target-m7269","kube-system/global-pull-secret-syncer-jg2rt","kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-22fmx","openshift-multus/multus-89tnj","kube-system/konnectivity-agent-8b4lq","openshift-dns/node-resolver-xfkgh","openshift-network-operator/iptables-alerter-zg58k","openshift-ovn-kubernetes/ovnkube-node-7p44t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc","openshift-image-registry/node-ca-pdgpg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-mmtt5"]
Oct 31 12:58:58.878259 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.878226    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 12:58:58.878376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.878343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.880677 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.880656    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.882957 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.882936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:58.883074 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.883044    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:58:58.884255 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.884234    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 12:58:58.884357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.884298    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.884357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.884298    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.884357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.884301    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 12:58:58.884357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.884332    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwtqn\""
Oct 31 12:58:58.885234 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.885217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.886166 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.886145    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 12:58:58.886254 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.886180    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.886254 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.886198    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 12:58:58.887291 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887356 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887299    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.887356 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887356 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887335    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887356 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887518 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.887518 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887518 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887612 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.887666 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887519    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887850 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.887850 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887769    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.887850 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.887850 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vt65\" (UniqueName: \"kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.887995    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888095 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lkgw\" (UniqueName: \"kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.888335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888247    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.888335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.888292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.889946 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.889927    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.895985 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.895958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:58.897943 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.897921    2584 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 12:58:58.898443 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.898425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:58.900883 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.900865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:58:58.901001 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.900928    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:58:58.903203 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.903182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:58.903292 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:58.903251    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:58:58.905508 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.905492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:58.907928 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.907906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:58.917843 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.917822    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggntk"
Oct 31 12:58:58.932808 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.932785    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggntk"
Oct 31 12:58:58.943498 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.943422    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 12:53:58 +0000 UTC" deadline="2028-05-16 03:36:01.232183787 +0000 UTC"
Oct 31 12:58:58.943498 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.943471    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13502h37m2.288716335s"
Oct 31 12:58:58.979527 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.979506    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 12:58:58.988487 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.988718 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.988718 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:58.988718 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znwwq\" (UniqueName: \"kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:58.988718 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988677    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.988718 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988814    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988884    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.988994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.988953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989084    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989124    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989165    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989182    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989225    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989250    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhgc\" (UniqueName: \"kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.989350 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989320    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989418    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989440    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989499    2584 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vt65\" (UniqueName: \"kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989566    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989643    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.989987    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:58.990050 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990023    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990028    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvdj\" (UniqueName: \"kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990068    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990111    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990314    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.990727 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wkx2\" (UniqueName: \"kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990904    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.990940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991018    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991048    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991205    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.991321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwshp\" (UniqueName: \"kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991807    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991894    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991928    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991965    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.991999    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:58.992018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992127    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992157    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxwh\" (UniqueName: \"kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xp2f\" (UniqueName: \"kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lkgw\" (UniqueName: \"kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992473    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992573    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.992868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.992715    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.993582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993234    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.993582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993305    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.993582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993353    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.993582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993407    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.993582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993518    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:58.993973 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.993590    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.994545 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.994100    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.994545 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.994207    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.995048 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.995023    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996005    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996057    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996067    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996102    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996129    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996170    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996187    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996294    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996357    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtxsh\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996365    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996392    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996403    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996392    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mw6wr\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996414    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996442    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drb8j\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996450    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-2x4wq\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996477    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996479    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7lhn5\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996481    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996533    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 12:58:58.996593 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.996563    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.997503 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997460    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2xlcn\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997543    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997551    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997610    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997602    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5b9kz\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997672    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kvxk\""
Oct 31 12:58:58.997742 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:58.997665    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 12:58:59.005097 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.005069    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vt65\" (UniqueName: \"kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:59.007985 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.007959    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lkgw\" (UniqueName: \"kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:59.093061 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093073    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwshp\" (UniqueName: \"kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093143    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093248    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093357 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxwh\" (UniqueName: \"kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093429    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xp2f\" (UniqueName: \"kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093511    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093564    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093568    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093570    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znwwq\" (UniqueName: \"kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093605    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093332    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093709    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.093950 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093717    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093477    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093840    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093892    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093894    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093932    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.093992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhgc\" (UniqueName: \"kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094014    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094056    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094104    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094144    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094223    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.094799 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094650    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094782    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvdj\" (UniqueName: \"kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.094981    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095036    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095085    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.095095    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:58:59.595070486 +0000 UTC m=+2.094864788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.094985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095176    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.095725 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095227    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkx2\" (UniqueName: \"kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095335    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095342    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095466    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095535    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095658    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.096422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095849    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095914    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095976    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.095979    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096018    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097164 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096064    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096096    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096133    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096827    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096893    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.096982    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.097021    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.097023    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.097401    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:58:59.097910 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.097876    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:58:59.597854268 +0000 UTC m=+2.097648569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:58:59.098265 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.098063    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.098265 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.098147    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.098400 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.098376    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:59.099217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.099195    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.099383 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.099361    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:59.107751 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.107580    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:58:59.107751 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.107610    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:58:59.107751 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.107626    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:58:59.107751 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.107719    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:58:59.607675636 +0000 UTC m=+2.107469938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:58:59.108012 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.107845    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxwh\" (UniqueName: \"kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.108012 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.107884    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwshp\" (UniqueName: \"kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.108012 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.107898    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xp2f\" (UniqueName: \"kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.108589 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.108564    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhgc\" (UniqueName: \"kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.108737 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.108714    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znwwq\" (UniqueName: \"kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:59.109906 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.109889    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvdj\" (UniqueName: \"kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.110289 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.110270    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkx2\" (UniqueName: \"kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.238798 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.238749    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171d70015aed926fef2166fbf48d78ef.slice/crio-d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00 WatchSource:0}: Error finding container d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00: Status 404 returned error can't find the container with id d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00
Oct 31 12:58:59.239254 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.239233    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b35a27b51fd2e2aa7686bff71c7e43c.slice/crio-7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9 WatchSource:0}: Error finding container 7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9: Status 404 returned error can't find the container with id 7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9
Oct 31 12:58:59.244432 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.244415    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 12:58:59.246733 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.246707    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:58:59.254547 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.254416    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:58:59.257285 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.257254    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6a0aef_64f6_4163_8d5c_caf1f57f93dd.slice/crio-7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65 WatchSource:0}: Error finding container 7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65: Status 404 returned error can't find the container with id 7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65
Oct 31 12:58:59.263925 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.263896    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d4dd9c_e5b0_4b63_bcc8_275db18ac571.slice/crio-5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f WatchSource:0}: Error finding container 5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f: Status 404 returned error can't find the container with id 5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f
Oct 31 12:58:59.276384 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.276349    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:58:59.280384 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.280340    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:58:59.288645 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.288598    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode760ddce_c98f_4300_89ca_78471b37cb1e.slice/crio-aa9e6a4066bb6748aa9393651fac3fcba0f3f06e2c0407ead94aaacd02e4cb85 WatchSource:0}: Error finding container aa9e6a4066bb6748aa9393651fac3fcba0f3f06e2c0407ead94aaacd02e4cb85: Status 404 returned error can't find the container with id aa9e6a4066bb6748aa9393651fac3fcba0f3f06e2c0407ead94aaacd02e4cb85
Oct 31 12:58:59.290098 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.290078    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-89tnj"
Oct 31 12:58:59.291481 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.291453    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2777e0_8795_400c_b947_e5d9c5855018.slice/crio-2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8 WatchSource:0}: Error finding container 2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8: Status 404 returned error can't find the container with id 2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8
Oct 31 12:58:59.301294 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.301270    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf781e151_2c24_418f_87be_9047257f37f0.slice/crio-c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1 WatchSource:0}: Error finding container c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1: Status 404 returned error can't find the container with id c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1
Oct 31 12:58:59.303480 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.303446    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:58:59.313845 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.313818    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1ddc4d_ce47_4513_a98a_56a711911137.slice/crio-3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e WatchSource:0}: Error finding container 3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e: Status 404 returned error can't find the container with id 3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e
Oct 31 12:58:59.341260 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.341225    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:58:59.352133 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.352105    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda68c79_68ab_4536_b21d_28c8d819f8a3.slice/crio-6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1 WatchSource:0}: Error finding container 6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1: Status 404 returned error can't find the container with id 6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1
Oct 31 12:58:59.357186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.357165    2584 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:58:59.360092 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.360070    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:58:59.366374 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.366354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:58:59.370487 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.370457    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab4d3aa_6217_475e_afde_5888cc0afd88.slice/crio-fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d WatchSource:0}: Error finding container fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d: Status 404 returned error can't find the container with id fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d
Oct 31 12:58:59.376307 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:58:59.376278    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f1cfdb_416d_4fb6_9f72_e3349e3fcd14.slice/crio-0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef WatchSource:0}: Error finding container 0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef: Status 404 returned error can't find the container with id 0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef
Oct 31 12:58:59.378469 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.378451    2584 kuberuntime_manager.go:1707] "Unhandled Error" err="container node-ca start failed in pod node-ca-pdgpg_openshift-image-registry(b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Oct 31 12:58:59.378539 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.378483    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-image-registry/node-ca-pdgpg" podUID="b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14"
Oct 31 12:58:59.598531 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.598435    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:58:59.598531 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.598479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:58:59.598804 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.598602    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:58:59.598804 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.598638    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:58:59.598804 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.598681    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:00.598665282 +0000 UTC m=+3.098459564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:58:59.598804 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.598699    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:59:00.598690763 +0000 UTC m=+3.098485046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:58:59.699068 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.699027    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:58:59.699289 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.699194    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:58:59.699289 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.699218    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:58:59.699289 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.699233    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:58:59.699474 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.699335    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:00.699314518 +0000 UTC m=+3.199108800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:58:59.746270 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.746235    2584 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:58:59.936061 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.935938    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 12:53:59 +0000 UTC" deadline="2028-06-22 00:12:24.737358217 +0000 UTC"
Oct 31 12:58:59.936061 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.936013    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14387h13m24.801351307s"
Oct 31 12:58:59.971213 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.971145    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdgpg" event={"ID":"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14","Type":"ContainerStarted","Data":"0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef"}
Oct 31 12:58:59.973256 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:58:59.973219    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:11509ac76e128ae597c6ac16bf61ea639d70c1a8f19835bb5fc0d4c9fcf3867c\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-image-registry/node-ca-pdgpg" podUID="b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14"
Oct 31 12:58:59.975032 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.975001    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-89tnj" event={"ID":"f781e151-2c24-418f-87be-9047257f37f0","Type":"ContainerStarted","Data":"c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1"}
Oct 31 12:58:59.978178 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.978148    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerStarted","Data":"2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8"}
Oct 31 12:58:59.982942 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.982815    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22fmx" event={"ID":"e760ddce-c98f-4300-89ca-78471b37cb1e","Type":"ContainerStarted","Data":"aa9e6a4066bb6748aa9393651fac3fcba0f3f06e2c0407ead94aaacd02e4cb85"}
Oct 31 12:59:00.012729 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:58:59.994594    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65"}
Oct 31 12:59:00.012729 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.000459    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"3b35a27b51fd2e2aa7686bff71c7e43c","Type":"ContainerStarted","Data":"7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9"}
Oct 31 12:59:00.012729 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.004936    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8b4lq" event={"ID":"eab4d3aa-6217-475e-afde-5888cc0afd88","Type":"ContainerStarted","Data":"fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d"}
Oct 31 12:59:00.033004 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.032946    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xfkgh" event={"ID":"eda68c79-68ab-4536-b21d-28c8d819f8a3","Type":"ContainerStarted","Data":"6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1"}
Oct 31 12:59:00.053906 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.053790    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zg58k" event={"ID":"8c1ddc4d-ce47-4513-a98a-56a711911137","Type":"ContainerStarted","Data":"3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e"}
Oct 31 12:59:00.060165 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.060076    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc" event={"ID":"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571","Type":"ContainerStarted","Data":"5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f"}
Oct 31 12:59:00.066801 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.066763    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerStarted","Data":"d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00"}
Oct 31 12:59:00.608517 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.608468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:00.608722 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.608537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:00.608722 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.608652    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:00.608856 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.608732    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:02.608709072 +0000 UTC m=+5.108503372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:00.608856 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.608737    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:00.608856 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.608773    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:59:02.608762361 +0000 UTC m=+5.108556643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:00.710023 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.709976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:00.710304 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.710282    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:59:00.710398 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.710315    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:59:00.710398 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.710329    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:00.710503 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.710398    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:02.710376965 +0000 UTC m=+5.210171255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:00.892382 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.892141    2584 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:00.937253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.937170    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 12:53:59 +0000 UTC" deadline="2028-06-03 00:08:21.662297301 +0000 UTC"
Oct 31 12:59:00.937253 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.937244    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13931h9m20.725058269s"
Oct 31 12:59:00.958123 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.957983    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:00.958123 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.958127    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:00.958868 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.958690    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:00.958868 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.958813    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:00.959036 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:00.958892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:00.959036 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:00.958970    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:01.972594 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:01.972555    2584 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:02.628038 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.627976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:02.628038 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.628035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:02.628273 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.628211    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:02.628349 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.628280    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:59:06.628261755 +0000 UTC m=+9.128056056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:02.628418 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.628355    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:02.628418 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.628391    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:06.628379795 +0000 UTC m=+9.128174080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:02.730511 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.730132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:02.730511 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.730411    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:59:02.730511 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.730436    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:59:02.730511 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.730451    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:02.730511 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.730518    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:06.730498685 +0000 UTC m=+9.230292985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.957840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.957867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:02.957840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.958017    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.958118    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:02.958218 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:02.958183    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:04.105176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:04.104409    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="d28d5b24e47d8acf5d0c6053d7833ecd188526dd99e2b7fae2d78db57f404002" exitCode=0
Oct 31 12:59:04.105176 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:04.105097    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"d28d5b24e47d8acf5d0c6053d7833ecd188526dd99e2b7fae2d78db57f404002"}
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:04.958285    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:04.958408    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:04.958788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:04.958875    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:04.958931    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:04.959040 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:04.958999    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:05.113510 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:05.113430    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"3b35a27b51fd2e2aa7686bff71c7e43c","Type":"ContainerStarted","Data":"39e0ba197f1c6e694a4962dca4286d33d336f5aa020e1c1d5d801092e7b89679"}
Oct 31 12:59:05.116390 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:05.115671    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8b4lq" event={"ID":"eab4d3aa-6217-475e-afde-5888cc0afd88","Type":"ContainerStarted","Data":"7dc89ba079594e923958ed8d9f69ad17ae57928bf41cdf2514120c2e32d51b81"}
Oct 31 12:59:05.118862 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:05.118813    2584 generic.go:356] "Generic (PLEG): container finished" podID="171d70015aed926fef2166fbf48d78ef" containerID="b16b53129d4a844b1378bb409318fe74030e532ef8e325a3e5c4fa3f5c9cbec5" exitCode=0
Oct 31 12:59:05.118976 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:05.118857    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerDied","Data":"b16b53129d4a844b1378bb409318fe74030e532ef8e325a3e5c4fa3f5c9cbec5"}
Oct 31 12:59:05.162561 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:05.162497    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal" podStartSLOduration=6.162480198 podStartE2EDuration="6.162480198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:05.161746844 +0000 UTC m=+7.661541148" watchObservedRunningTime="2026-10-31 12:59:05.162480198 +0000 UTC m=+7.662274503"
Oct 31 12:59:06.123662 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.123556    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc" event={"ID":"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571","Type":"ContainerStarted","Data":"1895815a4ec503ff425f33602ec90a52fc5e49059414ab3bf244511af291cb98"}
Oct 31 12:59:06.128523 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.128075    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerStarted","Data":"2319edfd3df72ca4c322f0dcc49ed13f3ce810328c9bc8c4716370ade13a9574"}
Oct 31 12:59:06.148346 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.147578    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8b4lq" podStartSLOduration=3.52875054 podStartE2EDuration="8.14755766s" totalImagesPullingTime="4.61880712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:05.205191359 +0000 UTC m=+7.704985655" watchObservedRunningTime="2026-10-31 12:59:06.14755766 +0000 UTC m=+8.647351964"
Oct 31 12:59:06.148346 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.148122    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" podStartSLOduration=7.148113557 podStartE2EDuration="7.148113557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:06.147945846 +0000 UTC m=+8.647740150" watchObservedRunningTime="2026-10-31 12:59:06.148113557 +0000 UTC m=+8.647907861"
Oct 31 12:59:06.665828 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.665724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:06.666012 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.665831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:06.666012 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.665967    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:06.666138 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.666035    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:14.666016792 +0000 UTC m=+17.165811075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:06.666138 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.666105    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:06.666138 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.666139    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:59:14.66612756 +0000 UTC m=+17.165921841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:06.767203 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.767165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:06.767436 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.767414    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:59:06.767521 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.767445    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:59:06.767521 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.767458    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:06.767521 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.767517    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:14.767498949 +0000 UTC m=+17.267293235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.957811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.957962    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.958358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.958448    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:06.958510    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:06.958716 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:06.958595    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:07.449828 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.449760    2584 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 12:59:07.767690 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.767649    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:07.769053 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.769023    2584 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:07.945940 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.945868    2584 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T12:59:07.449793315Z","UUID":"04f2b255-1cf5-439f-b44f-efbb0756e9e0","Handler":null,"Name":"","Endpoint":""}
Oct 31 12:59:07.948010 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.947478    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 12:59:07.948010 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:07.947504    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 12:59:08.136203 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.136104    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xfkgh" event={"ID":"eda68c79-68ab-4536-b21d-28c8d819f8a3","Type":"ContainerStarted","Data":"8441ed9e1c1cbf0b5da8497dd8d2e72bf5a5d3e2310325663406d8633497e98d"}
Oct 31 12:59:08.140680 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.140646    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc" event={"ID":"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571","Type":"ContainerStarted","Data":"47d8c5b16fde9f82d3647fe4fd5a0c17e377502ca62c02f986ae0d5f50305676"}
Oct 31 12:59:08.144729 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.144703    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-89tnj" event={"ID":"f781e151-2c24-418f-87be-9047257f37f0","Type":"ContainerStarted","Data":"e7c8c04eae4a6f97bf54c3b2ba4561c2e04d40fd91a59f68a10dee29e71f1f05"}
Oct 31 12:59:08.156507 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.156156    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-xfkgh" podStartSLOduration=1.806367323 podStartE2EDuration="10.15613818s" totalImagesPullingTime="8.349770857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:08.155265436 +0000 UTC m=+10.655059739" watchObservedRunningTime="2026-10-31 12:59:08.15613818 +0000 UTC m=+10.655932484"
Oct 31 12:59:08.958719 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.958449    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:08.958719 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.958680    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:08.958719 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:08.958645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:08.959230 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:08.958796    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:08.959280 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:08.959243    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:08.959334 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:08.959317    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:09.149591 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:09.149509    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc" event={"ID":"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571","Type":"ContainerStarted","Data":"77baf2a5755a718c1bd86ca859b9a75ffef485455864e9914ba033a8bf88c8b1"}
Oct 31 12:59:09.151761 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:09.151724    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="c4b68ee44e85aeaad88e96baaf7a7807815ea90838be01061c0cbed1fa71ee77" exitCode=0
Oct 31 12:59:09.151956 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:09.151932    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"c4b68ee44e85aeaad88e96baaf7a7807815ea90838be01061c0cbed1fa71ee77"}
Oct 31 12:59:09.173769 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:09.173715    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-89tnj" podStartSLOduration=2.8785967550000002 podStartE2EDuration="11.173674456s" totalImagesPullingTime="8.295077701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:08.176810863 +0000 UTC m=+10.676605167" watchObservedRunningTime="2026-10-31 12:59:09.173674456 +0000 UTC m=+11.673468758"
Oct 31 12:59:09.174120 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:09.174094    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc" podStartSLOduration=2.23170387 podStartE2EDuration="11.174086467s" totalImagesPullingTime="8.942382597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:09.17226899 +0000 UTC m=+11.672063305" watchObservedRunningTime="2026-10-31 12:59:09.174086467 +0000 UTC m=+11.673880816"
Oct 31 12:59:10.155579 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.155547    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="ca1551ee54c8ed2616fc34419a8bd830c54192e8a4f11f603f1e159eea283e3a" exitCode=0
Oct 31 12:59:10.156149 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.155630    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"ca1551ee54c8ed2616fc34419a8bd830c54192e8a4f11f603f1e159eea283e3a"}
Oct 31 12:59:10.157086 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.157060    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22fmx" event={"ID":"e760ddce-c98f-4300-89ca-78471b37cb1e","Type":"ContainerStarted","Data":"edb6247c27374873418485b6c78baaa43f11952e1bce1c29c6449b14fc652fe7"}
Oct 31 12:59:10.158569 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.158542    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zg58k" event={"ID":"8c1ddc4d-ce47-4513-a98a-56a711911137","Type":"ContainerStarted","Data":"95c6a551543cb3b2ebd60c430fa8fdc1ba795ec62f9bf2faa6c0777042156d73"}
Oct 31 12:59:10.204632 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.204572    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22fmx" podStartSLOduration=1.682176853 podStartE2EDuration="12.204559754s" totalImagesPullingTime="10.522382901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:10.204419937 +0000 UTC m=+12.704214240" watchObservedRunningTime="2026-10-31 12:59:10.204559754 +0000 UTC m=+12.704354056"
Oct 31 12:59:10.222039 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.221977    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zg58k" podStartSLOduration=3.634280853 podStartE2EDuration="12.221957614s" totalImagesPullingTime="8.587676761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:10.221940013 +0000 UTC m=+12.721734315" watchObservedRunningTime="2026-10-31 12:59:10.221957614 +0000 UTC m=+12.721751919"
Oct 31 12:59:10.957934 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.957895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:10.957934 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.957928    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:10.958150 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:10.957912    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:10.958150 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:10.958018    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:10.958150 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:10.958079    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:10.958150 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:10.958135    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:12.165990 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:12.165947    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="34e32abb516f5f41f27e8e5f02bb033f35b2d8a7ad93b51ee62dda7585d56db7" exitCode=0
Oct 31 12:59:12.166721 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:12.166001    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"34e32abb516f5f41f27e8e5f02bb033f35b2d8a7ad93b51ee62dda7585d56db7"}
Oct 31 12:59:12.958371 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:12.958334    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:12.958756 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:12.958719    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:12.958756 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:12.958408    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:12.958933 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:12.958808    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:12.958933 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:12.958403    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:12.958933 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:12.958881    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:14.729266 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.728987    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:14.729266 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.729238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:14.729701 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.729142    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:14.729701 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.729340    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:30.729320009 +0000 UTC m=+33.229114291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 12:59:14.729701 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.729342    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:14.729701 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.729386    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret podName:4e5b53af-d841-4059-a555-4f61e331449d nodeName:}" failed. No retries permitted until 2026-10-31 12:59:30.729368242 +0000 UTC m=+33.229162523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret") pod "global-pull-secret-syncer-jg2rt" (UID: "4e5b53af-d841-4059-a555-4f61e331449d") : object "kube-system"/"original-pull-secret" not registered
Oct 31 12:59:14.830250 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.830208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:14.830446 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.830406    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 12:59:14.830446 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.830430    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 12:59:14.830446 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.830444    2584 projected.go:196] Error preparing data for projected volume kube-api-access-ns8gr for pod openshift-network-diagnostics/network-check-target-m7269: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:14.830587 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.830505    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr podName:e1c58f69-b807-48ae-8dca-102c8da839d4 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:30.830485509 +0000 UTC m=+33.330279811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ns8gr" (UniqueName: "kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr") pod "network-check-target-m7269" (UID: "e1c58f69-b807-48ae-8dca-102c8da839d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 12:59:14.957924 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.957764    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:14.958041 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.957777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:14.958041 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.957997    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:14.958117 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:14.957817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:14.958154 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.958064    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:14.958193 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:14.958157    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:15.176080 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.175991    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pdgpg" event={"ID":"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14","Type":"ContainerStarted","Data":"4736d81552fc4bb97c09c75ecc75dcede41f77991e3cf8aeee45dd00d0a55baf"}
Oct 31 12:59:15.178758 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.178728    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="c28bbd4288bc8910592cd62c70cc9913f9dc705c371a5373621b2e80de311482" exitCode=0
Oct 31 12:59:15.178905 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.178801    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"c28bbd4288bc8910592cd62c70cc9913f9dc705c371a5373621b2e80de311482"}
Oct 31 12:59:15.181636 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.181618    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:15.182001 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.181980    2584 generic.go:356] "Generic (PLEG): container finished" podID="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" containerID="7dec866e6b9b9f8634188328f625498bf5dc1f687ac363e6790d47d3f66f61d1" exitCode=1
Oct 31 12:59:15.182058 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182020    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"4ce1c29ebc52b2ae1f965f19294b85581e9812b84eadd970a78fd9c86f04d6fc"}
Oct 31 12:59:15.182102 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182066    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"78dd4727187f560f465a51f91a4cadcdb64a03edd9f0f3fe02955cb29fbb119d"}
Oct 31 12:59:15.182102 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182095    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"866e69fff791ae3907f6ea5b66626e800806f554e9265fb1b723763ba644b04a"}
Oct 31 12:59:15.182172 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182122    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"945d33f683b7d4a2bae5f8144302a411b1ca362ce4e7abfa168e5e4031266f2d"}
Oct 31 12:59:15.182172 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182148    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerDied","Data":"7dec866e6b9b9f8634188328f625498bf5dc1f687ac363e6790d47d3f66f61d1"}
Oct 31 12:59:15.182229 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.182175    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"a866220fd760206b779081ce1ed46af317c553847f166fa1c28ff649f22cf8f6"}
Oct 31 12:59:15.196806 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:15.196763    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pdgpg" podStartSLOduration=1.664338024 podStartE2EDuration="17.196751922s" totalImagesPullingTime="15.532413898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-10-31 12:59:15.196357495 +0000 UTC m=+17.696151797" watchObservedRunningTime="2026-10-31 12:59:15.196751922 +0000 UTC m=+17.696546225"
Oct 31 12:59:16.187116 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:16.187075    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="9306910ae8dbc62145adf167a41df426c83de91af3f5c106a67acb4cecf1bf41" exitCode=0
Oct 31 12:59:16.187504 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:16.187135    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerDied","Data":"9306910ae8dbc62145adf167a41df426c83de91af3f5c106a67acb4cecf1bf41"}
Oct 31 12:59:16.958138 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:16.958103    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:16.958287 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:16.958110    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:16.958287 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:16.958241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:16.958287 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:16.958241    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:16.958396 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:16.958313    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:16.958396 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:16.958370    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:17.192902 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:17.192826    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:17.193455 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:17.193200    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"656ace219eec1d290d176d2cdf313435596cb76324beb4c3f8b868cb4d5bdca7"}
Oct 31 12:59:17.196133 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:17.196109    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" event={"ID":"ab2777e0-8795-400c-b947-e5d9c5855018","Type":"ContainerStarted","Data":"a6a18fe993d3d24518b92a8cd9eac35b134cbf7af5354087b83c49380215cc37"}
Oct 31 12:59:17.227758 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:17.227714    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mmtt5" podStartSLOduration=7.972434628 podStartE2EDuration="19.227701947s" totalImagesPullingTime="11.255267319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:17.22727982 +0000 UTC m=+19.727074123" watchObservedRunningTime="2026-10-31 12:59:17.227701947 +0000 UTC m=+19.727496249"
Oct 31 12:59:18.957596 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:18.957567    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:18.958117 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:18.957641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:18.958117 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:18.957678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:18.958117 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:18.957841    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:18.958117 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:18.957891    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:18.958117 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:18.957938    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:19.203300 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.203058    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:19.203590 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.203568    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"63cdf3128a1c2d00cb2680d08fd1204b67f24c0057ae7cbebd9628b4806a9d7c"}
Oct 31 12:59:19.203856 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.203837    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:19.204042 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.204028    2584 scope.go:122] "RemoveContainer" containerID="7dec866e6b9b9f8634188328f625498bf5dc1f687ac363e6790d47d3f66f61d1"
Oct 31 12:59:19.222062 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.222036    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:19.856711 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.856675    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:19.856884 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.856804    2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:19.857338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:19.857322    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:20.214715 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.214598    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:20.228548 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.228520    2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:20.230236 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.228958    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" event={"ID":"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd","Type":"ContainerStarted","Data":"070b92fe2c735ee5fdbcfbf5e7bd3ad20382d61e6f2848c22f8bb5332d310068"}
Oct 31 12:59:20.230236 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.229212    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:20.247943 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.247917    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:20.268335 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.267416    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" podStartSLOduration=7.145110106 podStartE2EDuration="22.267399279s" totalImagesPullingTime="15.122289173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:20.26658281 +0000 UTC m=+22.766377139" watchObservedRunningTime="2026-10-31 12:59:20.267399279 +0000 UTC m=+22.767193582"
Oct 31 12:59:20.850113 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.850084    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wvpk"]
Oct 31 12:59:20.850275 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.850259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:20.850389 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:20.850365    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:20.850984 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.850962    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jg2rt"]
Oct 31 12:59:20.851110 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.851051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:20.851171 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:20.851118    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:20.851789 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.851771    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7269"]
Oct 31 12:59:20.851871 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:20.851860    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:20.851949 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:20.851934    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:21.230806 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:21.230783    2584 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:21.532527 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:21.532439    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:22.958064 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:22.958026    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:22.958064 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:22.958061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:22.958523 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:22.958061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:22.958523 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:22.958178    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:22.958523 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:22.958291    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:22.958523 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:22.958352    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:23.246700 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:23.246624    2584 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t" podUID="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" containerName="ovnkube-controller" probeResult="failure" output=""
Oct 31 12:59:24.957966 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:24.957926    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:24.957966 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:24.957965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:24.958372 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:24.957968    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:24.958372 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:24.958032    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:24.958372 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:24.958119    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:24.958372 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:24.958186    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:26.957457 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:26.957428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:26.957914 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:26.957428    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:26.957914 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:26.957538    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jg2rt" podUID="4e5b53af-d841-4059-a555-4f61e331449d"
Oct 31 12:59:26.957914 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:26.957429    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:26.957914 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:26.957746    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7269" podUID="e1c58f69-b807-48ae-8dca-102c8da839d4"
Oct 31 12:59:26.957914 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:26.957673    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wvpk" podUID="a30d5a30-8477-4610-a33c-37c17e6b994f"
Oct 31 12:59:27.233293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.233223    2584 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeReady"
Oct 31 12:59:27.233439 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.233358    2584 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 12:59:27.273524 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.273496    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xdvkn"]
Oct 31 12:59:27.281805 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.281774    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-z76m8"]
Oct 31 12:59:27.282297 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.282280    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:27.290815 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.290787    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.291130 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.291082    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z2j5"]
Oct 31 12:59:27.291238 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.291187    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:27.291497 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.291475    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.296316 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.296298    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pn27v"]
Oct 31 12:59:27.296419 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.296406    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:27.302475 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.302456    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 12:59:27.302760 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.302743    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.307506 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.307483    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 12:59:27.308582 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.308564    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64f9757499-rkffd"]
Oct 31 12:59:27.308706 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.308693    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.313590 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.313559    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"]
Oct 31 12:59:27.314321 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.314301    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.322909 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.322885    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"]
Oct 31 12:59:27.324328 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.323931    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.326218 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.326179    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"]
Oct 31 12:59:27.326324 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.326271    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.333480 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.333456    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"]
Oct 31 12:59:27.334170 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.334153    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.336494 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.336473    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"]
Oct 31 12:59:27.336783 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.336761    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:27.340283 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.340263    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ffdc6"]
Oct 31 12:59:27.340410 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.340358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.343687 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.343666    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"]
Oct 31 12:59:27.343821 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.343802    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.349729 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.349703    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 12:59:27.350003 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.349986    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.354033 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.354008    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"]
Oct 31 12:59:27.354152 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.354129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.358219 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.358202    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xdvkn"]
Oct 31 12:59:27.358294 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.358232    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z2j5"]
Oct 31 12:59:27.358294 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.358252    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-z76m8"]
Oct 31 12:59:27.358294 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.358273    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8qxn7"]
Oct 31 12:59:27.358391 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.358308    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:27.362045 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.362026    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pn27v"]
Oct 31 12:59:27.362138 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.362066    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9tlqt"]
Oct 31 12:59:27.362138 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.362129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.364747 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364731    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"]
Oct 31 12:59:27.364823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364755    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"]
Oct 31 12:59:27.364823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364769    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"]
Oct 31 12:59:27.364823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364784    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"]
Oct 31 12:59:27.364823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364802    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"]
Oct 31 12:59:27.364823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364822    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f9757499-rkffd"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364846    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364849    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364867    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tlqt"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364887    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8qxn7"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364907    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364920    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364944    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ffdc6"]
Oct 31 12:59:27.364968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.364962    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 12:59:27.392079 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392061    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 12:59:27.392152 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392121    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392149    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 12:59:27.392186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392181    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392246 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392186    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392246 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392240    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392301 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392284    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392339 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392329    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392533 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392522    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392565 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392550    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392565 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392554    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 12:59:27.392651 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392580    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392651 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392594    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 12:59:27.392651 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392601    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392657    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392661    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392686    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392699    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392721    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.392743 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392735    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 12:59:27.392914 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392760    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.392914 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.392767    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.393780 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393761    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.393859 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393785    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 12:59:27.393859 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393800    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.393859 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393810    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 12:59:27.393859 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393829    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 12:59:27.394127 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.393861    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 12:59:27.403077 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.403062    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 12:59:27.410021 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.409991    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 12:59:27.410021 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.409994    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410070    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410083    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410089    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410086    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410104    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410133    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410146    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410162    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410173    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410170    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410176    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410198    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-64mjv\""
Oct 31 12:59:27.410217 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410207    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 12:59:27.410823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410234    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 12:59:27.410823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410318    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gth9v\""
Oct 31 12:59:27.410823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410358    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ftfm5\""
Oct 31 12:59:27.410823 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410527    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 12:59:27.410984 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.410963    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 12:59:27.413136 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.413240 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413144    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.413240 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.413240 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.413240 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413199    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.413425 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.413425 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.413425 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.413425 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.413634 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.413634 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.413634 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.413783 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413694    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.413783 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdmb\" (UniqueName: \"kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.413881 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.413881 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.413958 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.413958 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.413958 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413949    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.414074 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.413982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.414074 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.414160 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhcz6\" (UniqueName: \"kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6\") pod \"kas-connection-checker-685895c7c9-z76m8\" (UID: \"71d315b5-1d7a-43ff-bc1d-a76f5306c665\") " pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:27.414160 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414111    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdbhb\" (UniqueName: \"kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.414254 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.414295 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.414342 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs8rr\" (UniqueName: \"kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.414342 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78p8\" (UniqueName: \"kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.414447 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.414447 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.414447 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlzxl\" (UniqueName: \"kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.414447 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.414660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.414660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.414660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414563    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ftpg\" (UniqueName: \"kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg\") pod \"network-check-source-6f78d59f99-h2pxh\" (UID: \"756e459d-0b4a-40ec-a66f-915f2176b815\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:27.414660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.414660 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6ktk\" (UniqueName: \"kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk\") pod \"kas-connection-checker-685895c7c9-7z2j5\" (UID: \"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2\") " pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccxf\" (UniqueName: \"kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf\") pod \"volume-data-source-validator-58c9f5f46d-gkjn2\" (UID: \"054bc5de-57fb-4e80-9a9e-9e9597cb112c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414813    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kkl8\" (UniqueName: \"kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.414920 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4cp5\" (UniqueName: \"kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5\") pod \"kas-connection-checker-685895c7c9-xdvkn\" (UID: \"8a491af0-7568-4bdd-8a92-8af22ed4b8a2\") " pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.414974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.415119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4w8s\" (UniqueName: \"kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.415147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.415172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.415202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.415338 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.415233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.515843 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515759    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.515843 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515815    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdmb\" (UniqueName: \"kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.515985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhcz6\" (UniqueName: \"kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6\") pod \"kas-connection-checker-685895c7c9-z76m8\" (UID: \"71d315b5-1d7a-43ff-bc1d-a76f5306c665\") " pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbhb\" (UniqueName: \"kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516212    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8rr\" (UniqueName: \"kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516293    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g27dp\" (UniqueName: \"kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78p8\" (UniqueName: \"kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516376 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516395    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzxl\" (UniqueName: \"kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516449    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftpg\" (UniqueName: \"kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg\") pod \"network-check-source-6f78d59f99-h2pxh\" (UID: \"756e459d-0b4a-40ec-a66f-915f2176b815\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.516706    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.016681519 +0000 UTC m=+30.516475828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516880    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.516983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.516891    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.517526 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517173    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.517526 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517239    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.517526 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517419    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.517526 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517457    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.517785 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517555    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.517828 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr2hk\" (UniqueName: \"kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.518020 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.517999    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.518020 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518012    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.518126 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518057    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6ktk\" (UniqueName: \"kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk\") pod \"kas-connection-checker-685895c7c9-7z2j5\" (UID: \"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2\") " pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccxf\" (UniqueName: \"kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf\") pod \"volume-data-source-validator-58c9f5f46d-gkjn2\" (UID: \"054bc5de-57fb-4e80-9a9e-9e9597cb112c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.518504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kkl8\" (UniqueName: \"kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.519059    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.519213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.519216    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.519776 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.519738    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.519867    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.519939    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.019920804 +0000 UTC m=+30.519715085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.519973    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520007    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4cp5\" (UniqueName: \"kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5\") pod \"kas-connection-checker-685895c7c9-xdvkn\" (UID: \"8a491af0-7568-4bdd-8a92-8af22ed4b8a2\") " pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w8s\" (UniqueName: \"kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520101    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.520216 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520215    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520379    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.520744 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.520454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.521267 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.521025    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.521459    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.521763    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.521857    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.521871    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.521916    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.021899647 +0000 UTC m=+30.521693942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.521989    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522067    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.522071    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522122    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.02210538 +0000 UTC m=+30.521899677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.522302    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522455    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522517    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.022500229 +0000 UTC m=+30.522294510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522812    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522829    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522886    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.022869927 +0000 UTC m=+30.522664213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.522938    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:27.525024 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.522975    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.523108    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.022962015 +0000 UTC m=+30.522756309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.523295    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.523541    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.524103    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.524685    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.524820    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.524924    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.525092    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.525745 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.525471    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.526036 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.526014    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.530065 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.530043    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdmb\" (UniqueName: \"kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.531517 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.531493    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbhb\" (UniqueName: \"kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.533103 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.532338    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftpg\" (UniqueName: \"kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg\") pod \"network-check-source-6f78d59f99-h2pxh\" (UID: \"756e459d-0b4a-40ec-a66f-915f2176b815\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:27.533753 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.533730    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhcz6\" (UniqueName: \"kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6\") pod \"kas-connection-checker-685895c7c9-z76m8\" (UID: \"71d315b5-1d7a-43ff-bc1d-a76f5306c665\") " pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:27.534862 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.534834    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.535545 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.535245    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.535545 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.535298    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:27.536036 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.536009    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4cp5\" (UniqueName: \"kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5\") pod \"kas-connection-checker-685895c7c9-xdvkn\" (UID: \"8a491af0-7568-4bdd-8a92-8af22ed4b8a2\") " pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:27.536420 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.536396    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8rr\" (UniqueName: \"kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:27.536753 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.536718    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6ktk\" (UniqueName: \"kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk\") pod \"kas-connection-checker-685895c7c9-7z2j5\" (UID: \"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2\") " pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:27.537186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.537162    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78p8\" (UniqueName: \"kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:27.537579 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.537561    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccxf\" (UniqueName: \"kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf\") pod \"volume-data-source-validator-58c9f5f46d-gkjn2\" (UID: \"054bc5de-57fb-4e80-9a9e-9e9597cb112c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:27.538385 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.538360    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kkl8\" (UniqueName: \"kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.538777 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.538754    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w8s\" (UniqueName: \"kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:27.541387 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.541051    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:27.542392 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.542369    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzxl\" (UniqueName: \"kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.604994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.604956    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:27.609522 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.609502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:27.618665 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.618645    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:27.621020 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.621094 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g27dp\" (UniqueName: \"kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.621094 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621072    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.621184 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.621184 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621149    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2hk\" (UniqueName: \"kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.621293 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.621422 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621406    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.621462 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.621413    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:27.621493 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:27.621479    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:28.121464114 +0000 UTC m=+30.621258398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:27.621721 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.621705    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.623779 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.623755    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.635061 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.635035    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2hk\" (UniqueName: \"kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.635162 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.635068    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g27dp\" (UniqueName: \"kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:27.660869 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.660853    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:27.661541 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.661520    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:27.677960 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.677936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:27.689274 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.689251    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:27.720237 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.720183    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:27.728018 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.727397    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:27.732337 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.732308    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:27.740513 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.738563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:27.852370 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.852308    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:27.969553 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.969519    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-z76m8"]
Oct 31 12:59:27.971898 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:27.971755    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-xdvkn"]
Oct 31 12:59:27.974158 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:27.974128    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d315b5_1d7a_43ff_bc1d_a76f5306c665.slice/crio-af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5 WatchSource:0}: Error finding container af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5: Status 404 returned error can't find the container with id af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5
Oct 31 12:59:27.974854 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:27.974834    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a491af0_7568_4bdd_8a92_8af22ed4b8a2.slice/crio-a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665 WatchSource:0}: Error finding container a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665: Status 404 returned error can't find the container with id a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665
Oct 31 12:59:28.018084 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.018058    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"]
Oct 31 12:59:28.023592 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.023566    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"]
Oct 31 12:59:28.025073 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.025043    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f52f053_a1fd_4300_ae84_ed2d1f280da2.slice/crio-8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4 WatchSource:0}: Error finding container 8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4: Status 404 returned error can't find the container with id 8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4
Oct 31 12:59:28.028451 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.028424    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9b93d3_7770_4815_9ede_5488c17e029f.slice/crio-6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b WatchSource:0}: Error finding container 6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b: Status 404 returned error can't find the container with id 6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b
Oct 31 12:59:28.032966 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.032936    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:28.033193 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:28.033193 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:28.033193 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:28.033193 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033090    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:28.033193 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:28.033439 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.033222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:28.033439 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.033347    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:28.033439 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.033400    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.033384505 +0000 UTC m=+31.533178802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036152    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036213    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036195256 +0000 UTC m=+31.535989554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036288    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036324    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036313076 +0000 UTC m=+31.536107372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036382    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036393    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036424    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036414496 +0000 UTC m=+31.536208792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036478    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036507    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036497979 +0000 UTC m=+31.536292261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036559    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036568    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036594    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036586498 +0000 UTC m=+31.536380793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:28.036921 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.036683    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.036672826 +0000 UTC m=+31.536467107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:28.056780 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.056757    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7z2j5"]
Oct 31 12:59:28.060704 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.060681    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd73d4b_84b4_4315_9b73_7e3aa648b9e2.slice/crio-6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea WatchSource:0}: Error finding container 6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea: Status 404 returned error can't find the container with id 6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea
Oct 31 12:59:28.104136 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.104101    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"]
Oct 31 12:59:28.108345 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.108255    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tlqt"]
Oct 31 12:59:28.112084 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.112053    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf9a029_b79a_4f07_a747_567708c4d2bc.slice/crio-c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82 WatchSource:0}: Error finding container c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82: Status 404 returned error can't find the container with id c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82
Oct 31 12:59:28.129711 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.129588    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ffdc6"]
Oct 31 12:59:28.134051 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.134025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:28.134192 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.134174    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:28.134268 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:28.134225    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:29.134213273 +0000 UTC m=+31.634007554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:28.134710 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.134686    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2822c2_f4d2_4b60_be36_8377ff659009.slice/crio-3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984 WatchSource:0}: Error finding container 3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984: Status 404 returned error can't find the container with id 3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984
Oct 31 12:59:28.156343 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.156318    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"]
Oct 31 12:59:28.159107 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.159085    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054bc5de_57fb_4e80_9a9e_9e9597cb112c.slice/crio-0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb WatchSource:0}: Error finding container 0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb: Status 404 returned error can't find the container with id 0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb
Oct 31 12:59:28.170386 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.170330    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"]
Oct 31 12:59:28.172897 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:28.172869    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756e459d_0b4a_40ec_a66f_915f2176b815.slice/crio-62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d WatchSource:0}: Error finding container 62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d: Status 404 returned error can't find the container with id 62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d
Oct 31 12:59:28.248573 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.248539    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-xdvkn" event={"ID":"8a491af0-7568-4bdd-8a92-8af22ed4b8a2","Type":"ContainerStarted","Data":"da6b3c85a4b7b6d9d1588436093fc26245ae2e8896b964b935e6b06cce84a6ab"}
Oct 31 12:59:28.248750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.248591    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-xdvkn" event={"ID":"8a491af0-7568-4bdd-8a92-8af22ed4b8a2","Type":"ContainerStarted","Data":"a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665"}
Oct 31 12:59:28.249726 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.249700    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ffdc6" event={"ID":"cc2822c2-f4d2-4b60-be36-8377ff659009","Type":"ContainerStarted","Data":"3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984"}
Oct 31 12:59:28.250865 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.250839    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m" event={"ID":"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2","Type":"ContainerStarted","Data":"40e829237c8e4e85df0702929ed3c7e36d08dcbc635576fc1f928b7bfde4b7e1"}
Oct 31 12:59:28.251943 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.251916    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2" event={"ID":"9f52f053-a1fd-4300-ae84-ed2d1f280da2","Type":"ContainerStarted","Data":"8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4"}
Oct 31 12:59:28.253062 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.253038    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerStarted","Data":"6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b"}
Oct 31 12:59:28.254407 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.254387    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-z76m8" event={"ID":"71d315b5-1d7a-43ff-bc1d-a76f5306c665","Type":"ContainerStarted","Data":"45866834987f521eb5e50e698620be9d908c21e61e4b00568a7dc4fbaba2d05c"}
Oct 31 12:59:28.254491 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.254418    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-z76m8" event={"ID":"71d315b5-1d7a-43ff-bc1d-a76f5306c665","Type":"ContainerStarted","Data":"af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5"}
Oct 31 12:59:28.255905 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.255883    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7z2j5" event={"ID":"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2","Type":"ContainerStarted","Data":"acc72d5d5d513a2c4a4caa0effa0efc4855393f307e1407ec9e7186312eb44c0"}
Oct 31 12:59:28.255988 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.255919    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7z2j5" event={"ID":"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2","Type":"ContainerStarted","Data":"6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea"}
Oct 31 12:59:28.256922 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.256904    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh" event={"ID":"756e459d-0b4a-40ec-a66f-915f2176b815","Type":"ContainerStarted","Data":"62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d"}
Oct 31 12:59:28.257985 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.257966    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tlqt" event={"ID":"dcf9a029-b79a-4f07-a747-567708c4d2bc","Type":"ContainerStarted","Data":"c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82"}
Oct 31 12:59:28.258946 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.258928    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2" event={"ID":"054bc5de-57fb-4e80-9a9e-9e9597cb112c","Type":"ContainerStarted","Data":"0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb"}
Oct 31 12:59:28.267671 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.267623    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-xdvkn" podStartSLOduration=332.267599611 podStartE2EDuration="5m32.267599611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:28.267280843 +0000 UTC m=+30.767075149" watchObservedRunningTime="2026-10-31 12:59:28.267599611 +0000 UTC m=+30.767393918"
Oct 31 12:59:28.286328 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.286251    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-7z2j5" podStartSLOduration=332.286239278 podStartE2EDuration="5m32.286239278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:28.285385776 +0000 UTC m=+30.785180079" watchObservedRunningTime="2026-10-31 12:59:28.286239278 +0000 UTC m=+30.786033578"
Oct 31 12:59:28.306486 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.306446    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-z76m8" podStartSLOduration=332.30643653 podStartE2EDuration="5m32.30643653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:28.305796217 +0000 UTC m=+30.805590521" watchObservedRunningTime="2026-10-31 12:59:28.30643653 +0000 UTC m=+30.806230849"
Oct 31 12:59:28.959637 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.958222    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:28.959801 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.958481    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:28.960244 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.958536    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:28.964983 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.964946    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 12:59:28.965092 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.965009    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-g22bl\""
Oct 31 12:59:28.965092 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.965073    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lsjfn\""
Oct 31 12:59:28.965207 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.965119    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lt4jt\""
Oct 31 12:59:28.966255 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:28.966232    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 12:59:29.042418 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042508    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042532    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042557    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042589    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.04256763 +0000 UTC m=+33.542361933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042671    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042687    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.042706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042735    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.042720475 +0000 UTC m=+33.542514758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042783    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.042771822 +0000 UTC m=+33.542566104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042870    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042907    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.042895239 +0000 UTC m=+33.542689522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:29.043139 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042968    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.042999    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.042988817 +0000 UTC m=+33.542783100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.043073    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.043084    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.043114    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.043104589 +0000 UTC m=+33.542898873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.043161    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:29.044142 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.043204    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.043191839 +0000 UTC m=+33.542986138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:29.143375 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:29.143337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:29.143596 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.143486    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:29.143596 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:29.143544    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:31.143527855 +0000 UTC m=+33.643322150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:30.763569 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.762685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:30.763569 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.762738    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:30.763569 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:30.763240    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 12:59:30.763569 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:30.763310    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 13:00:02.763289556 +0000 UTC m=+65.263083860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : secret "metrics-daemon-secret" not found
Oct 31 12:59:30.771859 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.769957    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:30.827244 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.827213    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:30.863968 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.863936    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:30.869409 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:30.869368    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.067998    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068073    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068105    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.068291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068441    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068507    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.068488318 +0000 UTC m=+37.568282602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068887    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068923    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.068913132 +0000 UTC m=+37.568707426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068959    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.068981    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.068972561 +0000 UTC m=+37.568766855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069028    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:31.069276 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069036    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069056    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.069050453 +0000 UTC m=+37.568844747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069088    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069106    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.069100743 +0000 UTC m=+37.568895036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069139    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069145    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069161    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.069156093 +0000 UTC m=+37.568950374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:31.069815 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.069198    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.069193121 +0000 UTC m=+37.568987402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:31.149271 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.149235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:31.158053 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.157835    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jg2rt"]
Oct 31 12:59:31.169167 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.169140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:31.169325 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.169304    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:31.169391 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:31.169378    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.16935799 +0000 UTC m=+37.669152289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:31.285280 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.285237    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jg2rt" event={"ID":"4e5b53af-d841-4059-a555-4f61e331449d","Type":"ContainerStarted","Data":"6930265d9088b556b93b663570e8990040867953f883882594cd87a4a4dfc1aa"}
Oct 31 12:59:31.287715 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.287669    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2" event={"ID":"054bc5de-57fb-4e80-9a9e-9e9597cb112c","Type":"ContainerStarted","Data":"c81c4811d21265343e472da807f4a04aa12181eed55377ef4e98ab50945b3a55"}
Oct 31 12:59:31.309372 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.309305    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2" podStartSLOduration=305.650300784 podStartE2EDuration="5m8.309284331s" totalImagesPullingTime="2.658983547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:31.308539221 +0000 UTC m=+33.808333535" watchObservedRunningTime="2026-10-31 12:59:31.309284331 +0000 UTC m=+33.809078635"
Oct 31 12:59:31.455696 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.455545    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:31.459315 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.459283    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7269"]
Oct 31 12:59:31.469709 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:31.469634    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c58f69_b807_48ae_8dca_102c8da839d4.slice/crio-cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f WatchSource:0}: Error finding container cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f: Status 404 returned error can't find the container with id cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f
Oct 31 12:59:31.597205 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:31.597173    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:32.205587 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.205155    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:32.294840 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.294446    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerStarted","Data":"f81c5bd0c433f3985cdc52059e414bdc9eb0da3898925a063779e3d354fa65d7"}
Oct 31 12:59:32.294840 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.294808    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:32.296461 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.296370    2584 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-jvcw2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Oct 31 12:59:32.296566 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.296469    2584 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused"
Oct 31 12:59:32.302266 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.302239    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7269" event={"ID":"e1c58f69-b807-48ae-8dca-102c8da839d4","Type":"ContainerStarted","Data":"cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f"}
Oct 31 12:59:32.354923 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:32.354839    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:33.319374 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.319326    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2" event={"ID":"9f52f053-a1fd-4300-ae84-ed2d1f280da2","Type":"ContainerStarted","Data":"e16fe1f4066a0f7aa28f9d84ff10a33835f158a1a5d9b813be1e6be479b30d5b"}
Oct 31 12:59:33.323512 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.323483    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/0.log"
Oct 31 12:59:33.323652 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.323525    2584 generic.go:356] "Generic (PLEG): container finished" podID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerID="f81c5bd0c433f3985cdc52059e414bdc9eb0da3898925a063779e3d354fa65d7" exitCode=255
Oct 31 12:59:33.323905 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.323845    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerDied","Data":"f81c5bd0c433f3985cdc52059e414bdc9eb0da3898925a063779e3d354fa65d7"}
Oct 31 12:59:33.323992 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.323918    2584 scope.go:122] "RemoveContainer" containerID="f81c5bd0c433f3985cdc52059e414bdc9eb0da3898925a063779e3d354fa65d7"
Oct 31 12:59:33.326347 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.326320    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ffdc6" event={"ID":"cc2822c2-f4d2-4b60-be36-8377ff659009","Type":"ContainerStarted","Data":"098563936aa395f403a3e4e4cc55beeaa73e7e1595e61205c44b989515237137"}
Oct 31 12:59:33.341056 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.341016    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podStartSLOduration=307.307351159 podStartE2EDuration="5m11.340976866s" totalImagesPullingTime="4.033625707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:32.319529051 +0000 UTC m=+34.819323358" watchObservedRunningTime="2026-10-31 12:59:33.340976866 +0000 UTC m=+35.840771171"
Oct 31 12:59:33.365632 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.364979    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2" podStartSLOduration=307.577190812 podStartE2EDuration="5m12.364960235s" totalImagesPullingTime="4.787769423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:33.340785963 +0000 UTC m=+35.840580270" watchObservedRunningTime="2026-10-31 12:59:33.364960235 +0000 UTC m=+35.864754539"
Oct 31 12:59:33.365632 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.365296    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-ffdc6" podStartSLOduration=303.687216655 podStartE2EDuration="5m8.365289815s" totalImagesPullingTime="4.67807316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:33.363384495 +0000 UTC m=+35.863178799" watchObservedRunningTime="2026-10-31 12:59:33.365289815 +0000 UTC m=+35.865084119"
Oct 31 12:59:33.469437 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.469295    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mq875"]
Oct 31 12:59:33.492446 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.492416    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mq875"]
Oct 31 12:59:33.492587 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.492563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.507444 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.506293    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:33.567275 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.567098    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qpv6m\""
Oct 31 12:59:33.567275 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.567172    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 12:59:33.567275 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.567233    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 12:59:33.593942 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.593849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p88h\" (UniqueName: \"kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.593942 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.593907    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.593942 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.593937    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.594316 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.594021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.594316 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.594049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.694821 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.694778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p88h\" (UniqueName: \"kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695004 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.694841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695004 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.694871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695004 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.694961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695004 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.694992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695288 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.695266    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.695722 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:33.695695    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:33.695831 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:33.695763    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:34.195744865 +0000 UTC m=+36.695539160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:33.696225 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.696191    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.696339 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:33.696261    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 12:59:33.696339 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:33.696307    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:34.196291633 +0000 UTC m=+36.696085928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : configmap "kube-rbac-proxy" not found
Oct 31 12:59:33.712382 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.712346    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p88h\" (UniqueName: \"kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:33.752865 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.752830    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:33.895994 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.895447    2584 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"]
Oct 31 12:59:33.903807 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.903775    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:33.920489 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.920468    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"]
Oct 31 12:59:33.920624 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.920579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:33.997695 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.997659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drbhx\" (UniqueName: \"kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx\") pod \"migrator-66df5d496b-qdk4f\" (UID: \"9cdb8256-bf4d-4bfe-aed0-97643a0151bb\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:33.998081 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.998061    2584 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lmj6s\""
Oct 31 12:59:33.998171 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.998068    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 12:59:33.998171 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:33.998151    2584 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:34.048767 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.048691    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:34.099923 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.099669    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbhx\" (UniqueName: \"kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx\") pod \"migrator-66df5d496b-qdk4f\" (UID: \"9cdb8256-bf4d-4bfe-aed0-97643a0151bb\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:34.125525 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.125487    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbhx\" (UniqueName: \"kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx\") pod \"migrator-66df5d496b-qdk4f\" (UID: \"9cdb8256-bf4d-4bfe-aed0-97643a0151bb\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:34.181087 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.181058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:34.200569 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.200536    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:34.200719 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.200678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:34.200781 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:34.200714    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:34.200817 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:34.200791    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.200771356 +0000 UTC m=+37.700565660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:34.200817 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:34.200805    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 12:59:34.200878 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:34.200863    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:35.200847785 +0000 UTC m=+37.700642071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : configmap "kube-rbac-proxy" not found
Oct 31 12:59:34.264489 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.264454    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:34.335866 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.335834    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:34.336437 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.336414    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/0.log"
Oct 31 12:59:34.336524 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.336459    2584 generic.go:356] "Generic (PLEG): container finished" podID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460" exitCode=255
Oct 31 12:59:34.337086 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.336927    2584 scope.go:122] "RemoveContainer" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"
Oct 31 12:59:34.337505 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.337326    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerDied","Data":"4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"}
Oct 31 12:59:34.337505 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.337473    2584 scope.go:122] "RemoveContainer" containerID="f81c5bd0c433f3985cdc52059e414bdc9eb0da3898925a063779e3d354fa65d7"
Oct 31 12:59:34.337900 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:34.337721    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:34.340936 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.340631    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tlqt" event={"ID":"dcf9a029-b79a-4f07-a747-567708c4d2bc","Type":"ContainerStarted","Data":"9faa9f2c2acaeb1d6c4e47ea9757543bb0ff8c9256b095defe76d6a93d6fa904"}
Oct 31 12:59:34.384783 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.383410    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9tlqt" podStartSLOduration=1.3230043980000001 podStartE2EDuration="7.383390304s" totalImagesPullingTime="6.060385906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:34.38286144 +0000 UTC m=+36.882655747" watchObservedRunningTime="2026-10-31 12:59:34.383390304 +0000 UTC m=+36.883184608"
Oct 31 12:59:34.594905 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:34.594871    2584 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"]
Oct 31 12:59:34.599651 ip-10-0-134-236 kubenswrapper[2584]: W1031 12:59:34.599619    2584 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdb8256_bf4d_4bfe_aed0_97643a0151bb.slice/crio-20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea WatchSource:0}: Error finding container 20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea: Status 404 returned error can't find the container with id 20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea
Oct 31 12:59:35.110594 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110638    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110679    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:35.110750 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110736    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.110784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110812    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.110791709 +0000 UTC m=+45.610586046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110865    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.110854425 +0000 UTC m=+45.610648707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110920    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110945    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.110938802 +0000 UTC m=+45.610733084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.110983    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:35.111019 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111007    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.110997315 +0000 UTC m=+45.610791597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111049    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111056    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111078    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.111070051 +0000 UTC m=+45.610864332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111115    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111144    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.111128244 +0000 UTC m=+45.610922526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111184    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111191    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:35.111336 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.111219    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.111213112 +0000 UTC m=+45.611007392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:35.211345 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.211311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:35.211477 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.211355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:35.211477 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211468    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:35.211552 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.211499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:35.211552 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211525    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.211507874 +0000 UTC m=+45.711302170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:35.211632 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211566    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:35.211632 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211601    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:37.211590419 +0000 UTC m=+39.711384713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:35.211704 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211653    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 12:59:35.211704 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.211682    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:37.211672198 +0000 UTC m=+39.711466479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : configmap "kube-rbac-proxy" not found
Oct 31 12:59:35.348041 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.348000    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m" event={"ID":"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2","Type":"ContainerStarted","Data":"f8d2ce96cfaccdec2f651c3005a7f3db5df40bf15ffc7250465d44e0c6173c8d"}
Oct 31 12:59:35.351174 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.351146    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:35.351587 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.351572    2584 scope.go:122] "RemoveContainer" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"
Oct 31 12:59:35.351807 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:35.351783    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:35.353703 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.353668    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh" event={"ID":"756e459d-0b4a-40ec-a66f-915f2176b815","Type":"ContainerStarted","Data":"a3d5cd0c928cd22ba695ee6c9e8df6861c452084b8bf2239e5799c5a7cb0df6a"}
Oct 31 12:59:35.356190 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.355804    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7269" event={"ID":"e1c58f69-b807-48ae-8dca-102c8da839d4","Type":"ContainerStarted","Data":"035e243f0ba4d0ce959033620fafba6a688e1a5283bc27bb76d09f6295dc00b0"}
Oct 31 12:59:35.356190 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.355924    2584 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:35.357295 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.357249    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f" event={"ID":"9cdb8256-bf4d-4bfe-aed0-97643a0151bb","Type":"ContainerStarted","Data":"20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea"}
Oct 31 12:59:35.369116 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.369068    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m" podStartSLOduration=303.894924231 podStartE2EDuration="5m10.369049536s" totalImagesPullingTime="6.474125305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:35.368293776 +0000 UTC m=+37.868088078" watchObservedRunningTime="2026-10-31 12:59:35.369049536 +0000 UTC m=+37.868843840"
Oct 31 12:59:35.388825 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.388721    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m7269" podStartSLOduration=33.790852716 podStartE2EDuration="37.388686582s" totalImagesPullingTime="3.597833866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:35.387897806 +0000 UTC m=+37.887692111" watchObservedRunningTime="2026-10-31 12:59:35.388686582 +0000 UTC m=+37.888480885"
Oct 31 12:59:35.399751 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.399703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:35.434509 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.434444    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh" podStartSLOduration=300.663364571 podStartE2EDuration="5m7.434421315s" totalImagesPullingTime="6.771056744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:35.412049626 +0000 UTC m=+37.911843930" watchObservedRunningTime="2026-10-31 12:59:35.434421315 +0000 UTC m=+37.934215614"
Oct 31 12:59:35.526560 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.526484    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:35.652225 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:35.652186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:36.111271 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:36.111221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:36.280892 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:36.280852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:36.607303 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:36.607264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:37.230991 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.230953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:37.231186 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.231054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:37.231186 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:37.231138    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:37.231298 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:37.231191    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 12:59:37.231298 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:37.231218    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.23119737 +0000 UTC m=+43.730991668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:37.231298 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:37.231243    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.231231611 +0000 UTC m=+43.731025892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : configmap "kube-rbac-proxy" not found
Oct 31 12:59:37.365532 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.365491    2584 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f" event={"ID":"9cdb8256-bf4d-4bfe-aed0-97643a0151bb","Type":"ContainerStarted","Data":"bbd4f0a540c1acc390ebaf49ec94db73e505ce19bfdfd3e52db08871f7da6c26"}
Oct 31 12:59:37.387026 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.386962    2584 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f" podStartSLOduration=2.669598066 podStartE2EDuration="4.386945728s" totalImagesPullingTime="1.717347662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 12:59:37.385788235 +0000 UTC m=+39.885582539" watchObservedRunningTime="2026-10-31 12:59:37.386945728 +0000 UTC m=+39.886740032"
Oct 31 12:59:37.678636 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.678531    2584 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:37.679104 ip-10-0-134-236 kubenswrapper[2584]: I1031 12:59:37.679009    2584 scope.go:122] "RemoveContainer" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"
Oct 31 12:59:37.679237 ip-10-0-134-236 kubenswrapper[2584]: E1031 12:59:37.679215    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:38.267165 ip-10-0-134-236 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 12:59:38.279142 ip-10-0-134-236 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 12:59:38.279379 ip-10-0-134-236 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 12:59:38.279450 ip-10-0-134-236 systemd[1]: kubelet.service: Consumed 3.139s CPU time.
Oct 31 12:59:38.295225 ip-10-0-134-236 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 12:59:38.395037 ip-10-0-134-236 kubenswrapper[4958]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:59:38.395037 ip-10-0-134-236 kubenswrapper[4958]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 12:59:38.395037 ip-10-0-134-236 kubenswrapper[4958]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:59:38.395037 ip-10-0-134-236 kubenswrapper[4958]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 12:59:38.397165 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397066    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.397165 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397165    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.397165 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397169    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397172    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397176    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397178    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397181    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397184    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397186    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397190    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397193    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397200    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397203    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397207    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397209    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397212    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397214    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397217    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397220    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397224    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397229    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.397268 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397233    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397236    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397240    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397243    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397246    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397255    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397258    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397261    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397264    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397266    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397269    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397272    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397275    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397277    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397280    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397283    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397286    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397288    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397291    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.397772 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397293    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397296    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397299    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397302    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397311    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397314    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397317    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397320    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397322    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397325    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397327    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397330    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397332    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397335    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397338    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397342    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397344    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397348    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397351    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397353    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.398257 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397356    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397358    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397361    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397365    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397369    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397371    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397374    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397377    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397380    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397383    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397385    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397388    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397390    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397393    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397398    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397400    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397403    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397411    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397414    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.398768 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397417    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397419    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397422    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397424    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397427    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397430    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397433    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397435    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397439    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397442    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397445    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397448    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397451    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397453    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397456    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397458    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397461    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397464    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397467    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397469    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.399290 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397472    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397474    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397477    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397480    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397482    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397486    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.397489    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398296    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398303    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398307    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398309    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398313    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398316    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398320    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398322    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398325    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398328    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398331    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398334    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.399856 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398336    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398340    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398343    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398346    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398350    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398354    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398356    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398359    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398362    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398364    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398367    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398370    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398372    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398375    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398377    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398380    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398382    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398387    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398391    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.400340 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398394    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398397    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398400    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398403    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398405    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398408    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398411    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398415    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398417    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398420    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398423    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398426    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398428    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398431    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398434    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398437    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398440    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398443    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398445    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398448    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.400828 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398450    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398453    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398456    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398459    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398461    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398464    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398466    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398469    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398472    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398474    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398477    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398479    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398482    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398485    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398487    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398490    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398492    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398495    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398498    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398505    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.401337 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398509    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398511    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398514    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398517    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398520    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398522    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398525    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398528    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398530    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398533    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398536    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398538    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398541    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398544    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398546    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398549    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398551    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398554    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398557    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398559    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.401851 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398562    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398564    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398567    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398570    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398573    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398575    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398578    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398581    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398583    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398586    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398588    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398591    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398599    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398617    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.398620    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399159    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399166    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399169    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399172    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.402345 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399174    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399177    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399180    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399183    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399186    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399194    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399197    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399200    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399203    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399205    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399208    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399211    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399213    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399216    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399219    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399223    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399226    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399229    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399231    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.402835 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399234    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399237    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399239    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399242    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399244    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399247    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399250    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399253    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399256    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399259    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399261    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399264    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399267    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399269    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399272    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399275    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399278    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399280    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399284    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399287    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.403311 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399289    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399292    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399295    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399298    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399301    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399304    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399306    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399310    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399313    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399316    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399319    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399322    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399324    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399327    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399329    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399332    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399335    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399337    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399340    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399343    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.403818 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399346    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399348    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399351    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399354    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399356    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399359    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399361    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399364    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399366    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399369    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399373    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399376    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399379    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399381    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399384    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399386    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399389    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399392    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399394    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399397    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.404348 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399399    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399402    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399405    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399408    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399410    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399413    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399416    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399418    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399421    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399423    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399426    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399428    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399436    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399438    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399441    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399443    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399446    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399449    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399451    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.404943 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399454    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399459    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399462    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.399467    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399564    4958 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399572    4958 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399579    4958 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399584    4958 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399588    4958 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399592    4958 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399596    4958 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399614    4958 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399618    4958 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399625    4958 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399629    4958 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399632    4958 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399636    4958 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399639    4958 flags.go:64] FLAG: --cgroup-root=""
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399642    4958 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399645    4958 flags.go:64] FLAG: --client-ca-file=""
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399648    4958 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399651    4958 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399655    4958 flags.go:64] FLAG: --cluster-domain=""
Oct 31 12:59:38.405773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399658    4958 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399661    4958 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399664    4958 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399669    4958 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399674    4958 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399677    4958 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399680    4958 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399684    4958 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399687    4958 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399690    4958 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399693    4958 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399696    4958 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399701    4958 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399705    4958 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399708    4958 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399711    4958 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399715    4958 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399718    4958 flags.go:64] FLAG: --enable-server="true"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399721    4958 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399726    4958 flags.go:64] FLAG: --event-burst="100"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399729    4958 flags.go:64] FLAG: --event-qps="50"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399732    4958 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399737    4958 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399740    4958 flags.go:64] FLAG: --eviction-hard=""
Oct 31 12:59:38.406390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399745    4958 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399748    4958 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399751    4958 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399754    4958 flags.go:64] FLAG: --eviction-soft=""
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399758    4958 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399761    4958 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399764    4958 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399767    4958 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399770    4958 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399773    4958 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399776    4958 flags.go:64] FLAG: --feature-gates=""
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399781    4958 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399784    4958 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399788    4958 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399791    4958 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399794    4958 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399797    4958 flags.go:64] FLAG: --help="false"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399800    4958 flags.go:64] FLAG: --hostname-override="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399804    4958 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399807    4958 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399811    4958 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399814    4958 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399818    4958 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 12:59:38.407099 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399821    4958 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399824    4958 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399827    4958 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399830    4958 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399833    4958 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399836    4958 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399839    4958 flags.go:64] FLAG: --kube-reserved=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399844    4958 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399847    4958 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399850    4958 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399853    4958 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399857    4958 flags.go:64] FLAG: --lock-file=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399860    4958 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399863    4958 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399866    4958 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399872    4958 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399875    4958 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399878    4958 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399881    4958 flags.go:64] FLAG: --logging-format="text"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399884    4958 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399888    4958 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399891    4958 flags.go:64] FLAG: --manifest-url=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399895    4958 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399900    4958 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399903    4958 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 12:59:38.407717 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399907    4958 flags.go:64] FLAG: --max-pods="110"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399910    4958 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399913    4958 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399916    4958 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399920    4958 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399923    4958 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399926    4958 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399929    4958 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399936    4958 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399939    4958 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399942    4958 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399946    4958 flags.go:64] FLAG: --pod-cidr=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399948    4958 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399952    4958 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399956    4958 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399960    4958 flags.go:64] FLAG: --port="10250"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399963    4958 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399966    4958 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0169768e5677c626c"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399969    4958 flags.go:64] FLAG: --qos-reserved=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399972    4958 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399975    4958 flags.go:64] FLAG: --register-node="true"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399978    4958 flags.go:64] FLAG: --register-with-taints=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399986    4958 flags.go:64] FLAG: --registry-burst="10"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399988    4958 flags.go:64] FLAG: --registry-qps="5"
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399992    4958 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399995    4958 flags.go:64] FLAG: --reserved-memory=""
Oct 31 12:59:38.408369 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.399999    4958 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400003    4958 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400006    4958 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400009    4958 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400012    4958 flags.go:64] FLAG: --runonce="false"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400016    4958 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400019    4958 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400022    4958 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400025    4958 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400028    4958 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400033    4958 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400036    4958 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400039    4958 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400042    4958 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400046    4958 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400048    4958 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400052    4958 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400055    4958 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400058    4958 flags.go:64] FLAG: --system-cgroups=""
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400061    4958 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400067    4958 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400070    4958 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400073    4958 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400078    4958 flags.go:64] FLAG: --tls-min-version=""
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400080    4958 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 12:59:38.409072 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400083    4958 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400086    4958 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400089    4958 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400092    4958 flags.go:64] FLAG: --v="2"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400097    4958 flags.go:64] FLAG: --version="false"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400101    4958 flags.go:64] FLAG: --vmodule=""
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400105    4958 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400108    4958 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400247    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400251    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400254    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400256    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400260    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400263    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400266    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400268    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400271    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400275    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400278    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400281    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400283    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.409735 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400286    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400288    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400291    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400294    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400296    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400299    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400303    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400305    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400308    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400311    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400313    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400316    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400318    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400320    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400323    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400326    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400328    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400331    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400333    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400336    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.410275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400339    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400341    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400345    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400348    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400351    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400354    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400356    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400359    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400363    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400365    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400368    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400370    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400373    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400376    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400378    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400381    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400383    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400386    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400390    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.410831 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400393    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400395    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400399    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400404    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400407    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400410    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400413    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400416    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400418    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400421    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400424    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400426    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400429    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400431    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400434    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400437    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400439    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400442    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400445    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.411318 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400447    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400450    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400454    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400457    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400459    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400462    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400464    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400467    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400470    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400472    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400475    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400478    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400482    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400484    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400487    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400490    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400493    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400496    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400498    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400501    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.411867 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400503    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400507    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400511    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400514    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400517    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400519    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400522    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400524    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400527    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400529    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400532    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400535    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400538    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400540    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400545    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.412476 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.400571    4958 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400620    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400625    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400628    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400631    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400633    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400636    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400639    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400641    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400646    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400648    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400651    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400654    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400656    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400659    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400662    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400664    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400667    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400671    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400673    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400676    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.413037 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400678    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400681    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400684    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400686    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400689    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400692    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400695    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400697    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400700    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400703    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400706    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400710    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400713    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400716    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400718    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400721    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400724    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400728    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400732    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.413843 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400735    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400739    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400742    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400744    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400747    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400749    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400752    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400754    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400757    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400760    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400762    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400765    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400767    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400770    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400773    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400775    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400778    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400780    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400783    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.414396 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400786    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400788    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400791    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400793    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400796    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400800    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400803    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400806    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400809    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400811    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400814    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400817    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400820    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400823    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400827    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400830    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400833    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400837    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400841    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.415005 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400844    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400847    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400850    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400853    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400855    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400858    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400860    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400863    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400866    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400869    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400871    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400874    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400876    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400879    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400881    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400884    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400886    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400889    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400897    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.415621 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400900    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400903    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400906    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400908    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400911    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400913    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400916    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400919    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400922    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.400925    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.405410    4958 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.405435    4958 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.405460    4958 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.405467    4958 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405677    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405686    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405691    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405696    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405701    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.416275 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405705    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405709    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405714    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405718    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405722    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405727    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405731    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405737    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405747    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405751    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405755    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405759    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405764    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405768    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405772    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405776    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405782    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405787    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405792    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.416880 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405797    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405802    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405811    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405815    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.405879    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406027    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406037    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406044    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406048    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406051    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406055    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406058    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406062    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406065    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406068    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406071    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406074    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406076    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406080    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406082    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.417391 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406085    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406088    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406092    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406095    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406097    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406100    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406103    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406106    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406109    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406112    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406115    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406118    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406121    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406124    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406127    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406130    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406133    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406135    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406140    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406144    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.417978 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406147    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406150    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406153    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406156    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406159    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406163    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406165    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406168    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406171    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406177    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406181    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406186    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406189    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406192    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406195    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406199    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406202    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406207    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406211    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.418510 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406215    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406219    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406222    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406226    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406228    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406231    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406235    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406237    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406240    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406243    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406245    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406249    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406255    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406258    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406263    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406266    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406270    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406273    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406276    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406279    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.419055 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406282    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406285    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406288    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.406337    4958 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406515    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406524    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406527    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406530    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406533    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406537    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406539    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406542    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406545    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406548    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406551    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406554    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.419775 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406556    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406559    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406562    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406564    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406567    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406571    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406574    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406577    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406580    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406583    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406586    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406589    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406592    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406595    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406598    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406601    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406624    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406628    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406632    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406635    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.420196 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406638    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406641    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406644    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406646    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406649    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406651    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406657    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406660    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406664    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406667    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406670    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406672    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406675    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406678    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406681    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406683    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406686    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406690    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406694    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406696    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.420719 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406700    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406702    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406705    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406708    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406711    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406713    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406716    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406719    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406722    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406724    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406727    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406729    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406732    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406735    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406737    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406740    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406742    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406745    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406748    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.421247 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406752    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406755    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406760    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406765    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406768    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406772    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406776    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406779    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406782    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406786    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406789    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406793    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406795    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406798    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406801    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406803    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406806    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406809    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.421846 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406811    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406814    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406817    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406819    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406823    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406826    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406828    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406831    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406833    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406836    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406838    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406841    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406844    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406846    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406849    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406853    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.422347 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406855    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.406883    4958 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406920    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406925    4958 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406928    4958 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406932    4958 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406935    4958 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406938    4958 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406941    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406948    4958 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406951    4958 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406954    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406956    4958 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406959    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406963    4958 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406966    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 12:59:38.422820 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406969    4958 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406971    4958 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406974    4958 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406977    4958 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406980    4958 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406983    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406985    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406988    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406991    4958 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406994    4958 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406996    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.406999    4958 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407002    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407005    4958 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407007    4958 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407011    4958 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407014    4958 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407018    4958 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407020    4958 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407023    4958 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 12:59:38.423239 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407026    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407029    4958 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407032    4958 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407035    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407037    4958 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407042    4958 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407045    4958 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407048    4958 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407051    4958 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407053    4958 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407056    4958 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407058    4958 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407062    4958 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407065    4958 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407067    4958 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407070    4958 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407072    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407075    4958 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407078    4958 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 12:59:38.424002 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407085    4958 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407088    4958 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407091    4958 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407094    4958 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407096    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407100    4958 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407103    4958 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407106    4958 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407109    4958 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407112    4958 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407115    4958 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407118    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407121    4958 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407124    4958 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407127    4958 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407130    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407133    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407135    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407147    4958 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407150    4958 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 12:59:38.424503 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407153    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407156    4958 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407159    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407161    4958 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407164    4958 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407167    4958 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407172    4958 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407175    4958 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407179    4958 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407183    4958 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407187    4958 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407190    4958 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407196    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407199    4958 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407202    4958 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407205    4958 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407208    4958 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407212    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 12:59:38.425062 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407216    4958 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407219    4958 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407222    4958 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407226    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407228    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407232    4958 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407234    4958 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407237    4958 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407240    4958 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407243    4958 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407246    4958 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407248    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407253    4958 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407256    4958 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:38.407258    4958 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.407340    4958 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.408721    4958 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.408817    4958 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.409039    4958 server.go:1014] "Starting client certificate rotation"
Oct 31 12:59:38.425588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.409179    4958 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.409269    4958 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 12:53:58 +0000 UTC" deadline="2028-07-29 04:42:45.7476005 +0000 UTC"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.409311    4958 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15279h43m7.338292305s"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.409650    4958 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.411063    4958 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.413158    4958 log.go:25] "Validated CRI v1 runtime API"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.415637    4958 log.go:25] "Validated CRI v1 image API"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.416805    4958 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 12:59:38.426122 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.419382    4958 fs.go:135] Filesystem UUIDs: map[4b4f37a8-6f77-4d4b-946d-67845a58cae4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8fea849b-88d0-4208-bc57-75b29a5c92ff:/dev/nvme0n1p3]
Oct 31 12:59:38.426366 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.419414    4958 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea/userdata/shm major:0 minor:318 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40e829237c8e4e85df0702929ed3c7e36d08dcbc635576fc1f928b7bfde4b7e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40e829237c8e4e85df0702929ed3c7e36d08dcbc635576fc1f928b7bfde4b7e1/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6930265d9088b556b93b663570e8990040867953f883882594cd87a4a4dfc1aa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6930265d9088b556b93b663570e8990040867953f883882594cd87a4a4dfc1aa/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/054bc5de-57fb-4e80-9a9e-9e9597cb112c/volumes/kubernetes.io~projected/kube-api-access-mccxf:{mountpoint:/var/lib/kubelet/pods/054bc5de-57fb-4e80-9a9e-9e9597cb112c/volumes/kubernetes.io~projected/kube-api-access-mccxf major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~projected/kube-api-access-xdbhb:{mountpoint:/var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~projected/kube-api-access-xdbhb major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7/volumes/kubernetes.io~projected/kube-api-access-l78p8:{mountpoint:/var/lib/kubelet/pods/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7/volumes/kubernetes.io~projected/kube-api-access-l78p8 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/kube-api-access-lf52c:{mountpoint:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/kube-api-access-lf52c major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3927981d-3a6e-44a0-a152-81798795fa9f/volumes/kubernetes.io~projected/kube-api-access-g27dp:{mountpoint:/var/lib/kubelet/pods/3927981d-3a6e-44a0-a152-81798795fa9f/volumes/kubernetes.io~projected/kube-api-access-g27dp major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e5b53af-d841-4059-a555-4f61e331449d/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/4e5b53af-d841-4059-a555-4f61e331449d/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6129e35b-f819-4c82-9fdf-f51ec2d69bf0/volumes/kubernetes.io~projected/kube-api-access-8p88h:{mountpoint:/var/lib/kubelet/pods/6129e35b-f819-4c82-9fdf-f51ec2d69bf0/volumes/kubernetes.io~projected/kube-api-access-8p88h major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2/volumes/kubernetes.io~projected/kube-api-access-f6ktk:{mountpoint:/var/lib/kubelet/pods/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2/volumes/kubernetes.io~projected/kube-api-access-f6ktk major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71d315b5-1d7a-43ff-bc1d-a76f5306c665/volumes/kubernetes.io~projected/kube-api-access-zhcz6:{mountpoint:/var/lib/kubelet/pods/71d315b5-1d7a-43ff-bc1d-a76f5306c665/volumes/kubernetes.io~projected/kube-api-access-zhcz6 major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/756e459d-0b4a-40ec-a66f-915f2176b815/volumes/kubernetes.io~projected/kube-api-access-7ftpg:{mountpoint:/var/lib/kubelet/pods/756e459d-0b4a-40ec-a66f-915f2176b815/volumes/kubernetes.io~projected/kube-api-access-7ftpg major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~projected/kube-api-access-zs8rr:{mountpoint:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~projected/kube-api-access-zs8rr major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/default-certificate major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/stats-auth major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a491af0-7568-4bdd-8a92-8af22ed4b8a2/volumes/kubernetes.io~projected/kube-api-access-b4cp5:{mountpoint:/var/lib/kubelet/pods/8a491af0-7568-4bdd-8a92-8af22ed4b8a2/volumes/kubernetes.io~projected/kube-api-access-b4cp5 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c1ddc4d-ce47-4513-a98a-56a711911137/volumes/kubernetes.io~projected/kube-api-access-qnvdj:{mountpoint:/var/lib/kubelet/pods/8c1ddc4d-ce47-4513-a98a-56a711911137/volumes/kubernetes.io~projected/kube-api-access-qnvdj major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~projected/kube-api-access-5vt65:{mountpoint:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~projected/kube-api-access-5vt65 major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cdb8256-bf4d-4bfe-aed0-97643a0151bb/volumes/kubernetes.io~projected/kube-api-access-drbhx:{mountpoint:/var/lib/kubelet/pods/9cdb8256-bf4d-4bfe-aed0-97643a0151bb/volumes/kubernetes.io~projected/kube-api-access-drbhx major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~projected/kube-api-access-4kkl8:{mountpoint:/var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~projected/kube-api-access-4kkl8 major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a30d5a30-8477-4610-a33c-37c17e6b994f/volumes/kubernetes.io~projected/kube-api-access-znwwq:{mountpoint:/var/lib/kubelet/pods/a30d5a30-8477-4610-a33c-37c17e6b994f/volumes/kubernetes.io~projected/kube-api-access-znwwq major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab2777e0-8795-400c-b947-e5d9c5855018/volumes/kubernetes.io~projected/kube-api-access-9wkx2:{mountpoint:/var/lib/kubelet/pods/ab2777e0-8795-400c-b947-e5d9c5855018/volumes/kubernetes.io~projected/kube-api-access-9wkx2 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14/volumes/kubernetes.io~projected/kube-api-access-5bxwh:{mountpoint:/var/lib/kubelet/pods/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14/volumes/kubernetes.io~projected/kube-api-access-5bxwh major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571/volumes/kubernetes.io~projected/kube-api-access-6lkgw:{mountpoint:/var/lib/kubelet/pods/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571/volumes/kubernetes.io~projected/kube-api-access-6lkgw major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~projected/kube-api-access-tlzxl:{mountpoint:/var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~projected/kube-api-access-tlzxl major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~projected/kube-api-access-lkdmb:{mountpoint:/var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~projected/kube-api-access-lkdmb major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~projected/kube-api-access-mr2hk:{mountpoint:/var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~projected/kube-api-access-mr2hk major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~secret/cert major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1c58f69-b807-48ae-8dca-102c8da839d4/volumes/kubernetes.io~projected/kube-api-access-ns8gr:{mountpoint:/var/lib/kubelet/pods/e1c58f69-b807-48ae-8dca-102c8da839d4/volumes/kubernetes.io~projected/kube-api-access-ns8gr major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/kube-api-access-8mtr9:{mountpoint:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/kube-api-access-8mtr9 major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~projected/kube-api-access-mwshp:{mountpoint:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~projected/kube-api-access-mwshp major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eab4d3aa-6217-475e-afde-5888cc0afd88/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/eab4d3aa-6217-475e-afde-5888cc0afd88/volumes/kubernetes.io~secret/agent-certs major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eda68c79-68ab-4536-b21d-28c8d819f8a3/volumes/kubernetes.io~projected/kube-api-access-2xp2f:{mountpoint:/var/lib/kubelet/pods/eda68c79-68ab-4536-b21d-28c8d819f8a3/volumes/kubernetes.io~projected/kube-api-access-2xp2f major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e/volumes/kubernetes.io~projected/kube-api-access-w4w8s:{mountpoint:/var/lib/kubelet/pods/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e/volumes/kubernetes.io~projected/kube-api-access-w4w8s major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f781e151-2c24-418f-87be-9047257f37f0/volumes/kubernetes.io~projected/kube-api-access-2vhgc:{mountpoint:/var/lib/kubelet/pods/f781e151-2c24-418f-87be-9047257f37f0/volumes/kubernetes.io~projected/kube-api-access-2vhgc major:0 minor:57 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/6f3673f5e1938773b1c93cdedec66d5df59ea7f87a39052014611b707b91bf42/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/fbe19c4fb787162aee12d112245b6dcf4488733fb778b6de6f2404983034b578/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-103:{mountpoint:/var/lib/containers/storage/overlay/ecc10549343c475e45099f36710261278a26ecf3c1664da604cfce2def7dd2c8/merged major:0 minor:103 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/0af23b5285bd722be0c84b408ad5b97079853251b56e00247d1d611df6d5e75d/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/0c2312037eb3f633013971d27325aa72b3b2a222fae62712f03f92e842068cc9/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4b03d7f62ce603c3acbb5600da33d1e8b750ea289d0a2e36155bec09a167aced/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-122:{mountpoint:/var/lib/containers/storage/overlay/1b4998b659563b05bd85a57c084b2f36b8744b8786a2e375c746b0e8ac9e05fe/merged major:0 minor:122 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8e360148d20e2abe46fe5ad9bb7b5ebc5052c98315e41504eeafb26d0a448f06/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/5b832377fb631b6e2b70eab8d75d34d70f959816599333eeddbd8d7b6270cff1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/522b3def29661b882fe26f39ad5ea62d37af8edd5859c9eab2fbf2493176a51d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/8d13fe422a5c5fad59d9de4586b4e4f21c186358d4c15005b1d0523b70cb828e/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/67fcd7a8044f59f69cfa03b472c46a802dbf93d9e4cfc301b702f0936a91eccb/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/59f36bc5ec9debb03621eb7d16847eb1a8396e795cd712593a477c394016af3b/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cb0c13a7bee43bf1290731a236c65fceeec2132fd362af670713905efce57c32/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/e12a41947cc32591d9b15145a1076ecc3a5c1174a9091c9add7d9e00a250444b/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/f731edfda4029c52cd61e4c11ada2ee5fef72dafcad0fe13ecb2c9a9b78b8b45/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ac8867c07857f9a72e57ed957a6c3e6b6c4d17c1e60dc2252f83e79bd02e84bf/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/cf463daff177bf45ead3427c1da4191d7bb39ed9273a2cd28bc5706ba7bb2ce7/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/b0f6b6bb9790b9c2d729d4b79da526bd9e01be51a31e71e2436e5d3240fa285c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/84d2b85cfcac0d4f7469a84738b8f186cbd8af95f52a3ce3aa1e37f8ce26ee4a/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/b8817102db64fc7ccd4989e0e69d492c1c0466ef493c629995ce205828560bca/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/9519ba7c513ee32307716c4357c3cce4cb7c198d29d70b9278fdd531b0a2a0f7/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/ac28968a8b94529f3cfe08c8397c353247c1f427ad9cc2cd2e722c7ecd5f95cc/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/1e34dd9cd359bff29ab82ec02abd20ee6c3ac10a7fc81ef50f3171b50b688e72/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/05563b30f59a7498700270c573cf5504f0fcf01cfed42fc93b9724cd7cad9c7c/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/7f9bd74f573eef9401562ac80f00e0ea3f496d9acedb48b5d36cc3d49294cbb7/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/62bdce820aa93c6ecbbd2f9774405e6e2bb221f0ab984be1ca68fbb36ffd42ac/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/e88c95375ce57cfc41430b1024cd91853f7e6bebf164fea17aff8bcc31b613fb/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/8908fe7932f4565e4fec2163c65c781c921245d4a241a2c52f3e4bab7be6998c/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/fdd1722f3abc158490382fd8db8ca1b3162b25903f462e90da62518061e8cb44/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/61287c4323833251038350ed7ea1d6bc5f399e906ecfaaa6d71ef98118c18c56/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/98293b7ff282d3a1a6a11ba83a3db5769263dc64c9e0071198e507b150a0666c/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/cad463bccb670c23ca8f354ce198e25b3affe57f84e1b267e55ddbf2e15ad21a/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/47d4ee726e34e971331687b78073934bf96c9c7ef471444f2c15030fe61d554c/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/00bcd21aedf4b0adae066d21b034d2329c2923fa6f381aa21a0ccf5e121681e9/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/08d9d0d26d5ebf63c3b3d436d2075fe2f5996a45fccf186103500e6eefc35344/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/ee36acd6619332c7ddf2cfc404e813bdb9367a822b86ec340ce460ae3ecfd66b/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/4390dbf901b2d73abc33f9f1914df6878eb21b02b5a2ca8b971488b3b9a19717/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/1eb7146f5c8e8aed90e405eac68d7613d3801ff431fe28cdfd47e621cf29f8c1/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/b9d6442522970fd9e9abb46f2c37683290766f24835f943516c0726bdfd43e4f/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/d19f36b0baa4a98b0d73286adcc1e81d9f1e09c67d03c743270e3057b15cec80/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/986de68fea33b173c22befee201c2946441423929d811f2fed227590c3c2f1be/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/fd025c654f8ffd4c37bad140d050d4edc8736c6a8e19cf2d65339bf49574faac/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/d164ab03e122d0f1b47228272bb88494d71d78f8ca6f349ec57e7029cadcdd14/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/f6b956a603cf16b5c6ff8c530f514c2809f9fc1e11965cba790c4fa6aad6ad88/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/47c83d6e109e5be694b929120f76bafed5c067f382434ac9055120f3d2a0a18b/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/4e3afe05b02fa9d6d41b7bb24d5296ed439c7d6a9f1a08d436ec43234a833181/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/b023efbdaf240140a6a1473ae2232b2bec801e72e0d9da3b2d46e665f6a58934/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/6c0f526971548684fe2fda797a9f3325b7d936e3995bb6de0a4ca1dc14cf88d4/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/4e93c0c86a3f86e4aa2d911bef83ac5e061efd3bfc08c5b1fbf73001df8eb553/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/f5813aebb2d8ce4cc5ff604127e9628cda041395d3a6f5fbd7b6d63363b98c7c/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/d5b4bc9bbf656d81dbf1e69a0dc3a94359c77c75aa47705b7ff566c99f2b05c8/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/69aaf168c8c51fcbc72080a3f8d7479d93c6832f8a8dbeaceb0a7498fe15fecf/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/6440650e02c0f7daa3160dae662f823c1a7758eb08ffc8212f3d96a576825249/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/65d50f176982c4d75430f3154338e041bf99ca952e51d10faefa66813208db37/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/a21fa1603f311a14fd42a626d251262d7e6ef0c64759623d392ea613cb0074a5/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 31 12:59:38.430988 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.430617    4958 manager.go:217] Machine: {Timestamp:2026-10-31 12:59:38.430115803 +0000 UTC m=+0.093541479 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101641 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28dd06122bd8647f897737f811fa43 SystemUUID:ec28dd06-122b-d864-7f89-7737f811fa43 BootID:26e034af-e3d3-4621-9da3-7cfc51a16a14 Filesystems:[{Device:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eda68c79-68ab-4536-b21d-28c8d819f8a3/volumes/kubernetes.io~projected/kube-api-access-2xp2f DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5a841bfac1bcab74810195fd18de59455bebe92bdb0af18e42dedebafcae8f1f/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/054bc5de-57fb-4e80-9a9e-9e9597cb112c/volumes/kubernetes.io~projected/kube-api-access-mccxf DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4e5b53af-d841-4059-a555-4f61e331449d/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:280 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~projected/kube-api-access-lkdmb DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/62d983938c615cba354f61efa9067ac96c04226ff0a09db4f0e13aedd3f0401d/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/af0a9aae564308f0911d1f512467cd05f39a022240f35eef5f573831e8090cc5/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571/volumes/kubernetes.io~projected/kube-api-access-6lkgw DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/756e459d-0b4a-40ec-a66f-915f2176b815/volumes/kubernetes.io~projected/kube-api-access-7ftpg DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8a491af0-7568-4bdd-8a92-8af22ed4b8a2/volumes/kubernetes.io~projected/kube-api-access-b4cp5 DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9cdb8256-bf4d-4bfe-aed0-97643a0151bb/volumes/kubernetes.io~projected/kube-api-access-drbhx DeviceMajor:0 DeviceMinor:311 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3b1f82aaa681c7295ee77e4c2440e908df6b44fc3ed3f1c139fb6c416d276e5e/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~projected/kube-api-access-mr2hk DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ab2777e0-8795-400c-b947-e5d9c5855018/volumes/kubernetes.io~projected/kube-api-access-9wkx2 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa9a735248bc6e53b24e80888d3bd358eaf27ffaeae89cc6902bc778b749016d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volumes/kubernetes.io~projected/kube-api-access-5vt65 DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2e91fd26d1f55589bda98a8a822dff910981ed2ae3626512e4dd751c8304b6e8/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3927981d-3a6e-44a0-a152-81798795fa9f/volumes/kubernetes.io~projected/kube-api-access-g27dp DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc2822c2-f4d2-4b60-be36-8377ff659009/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~projected/kube-api-access-tlzxl DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eab4d3aa-6217-475e-afde-5888cc0afd88/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~projected/kube-api-access-mwshp DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a30d5a30-8477-4610-a33c-37c17e6b994f/volumes/kubernetes.io~projected/kube-api-access-znwwq DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c1ddc4d-ce47-4513-a98a-56a711911137/volumes/kubernetes.io~projected/kube-api-access-qnvdj DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-122 DeviceMajor:0 DeviceMinor:122 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2/volumes/kubernetes.io~projected/kube-api-access-f6ktk DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b7a36419fb78e004449402f3e5f2d1ead56b94ee8884325cfa95476dd77d2fb/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8b359b6ba602eb999041f2fbd8f77a31e7bb88f1a2ef73093e9267039df962b4/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40e829237c8e4e85df0702929ed3c7e36d08dcbc635576fc1f928b7bfde4b7e1/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6129e35b-f819-4c82-9fdf-f51ec2d69bf0/volumes/kubernetes.io~projected/kube-api-access-8p88h DeviceMajor:0 DeviceMinor:306 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-103 DeviceMajor:0 DeviceMinor:103 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~projected/kube-api-access-8mtr9 DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a698450e09db15baa4fc120a65d52dc0104b5ef47639f2c2e77298d404594665/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c67b4379cf52238a44b45fdb6fc0bb3e6ca47c717736351e8ad027d40b59fe82/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7/volumes/kubernetes.io~projected/kube-api-access-l78p8 DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e/volumes/kubernetes.io~projected/kube-api-access-w4w8s DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/kube-api-access-lf52c DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e1c58f69-b807-48ae-8dca-102c8da839d4/volumes/kubernetes.io~projected/kube-api-access-ns8gr DeviceMajor:0 DeviceMinor:292 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f52f053-a1fd-4300-ae84-ed2d1f280da2/volumes/kubernetes.io~projected/kube-api-access-4kkl8 DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14/volumes/kubernetes.io~projected/kube-api-access-5bxwh DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dcf9a029-b79a-4f07-a747-567708c4d2bc/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a4257ad452a19459bb1b45680344a283a619f021ac55a27946a8244a6cd96ea/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6537f8fc299f3933037b9f07ada6aee039f07c6b66e9b6333b8a443599de4e5b/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20f7c4f3fe235e8c746b052cba56a922976ee580739f04c142260267f5329aea/userdata/shm DeviceMajor:0 DeviceMinor:318 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6164eddc95db12d50e84271027c2ab960a89580f5ba6fb7474c82596010fcdd1/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/e760ddce-c98f-4300-89ca-78471b37cb1e/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6930265d9088b556b93b663570e8990040867953f883882594cd87a4a4dfc1aa/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d7906145f218bd28f811e08a820d06ed9b4ec88997f883360040285ae9687ef/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1a9b93d3-7770-4815-9ede-5488c17e029f/volumes/kubernetes.io~projected/kube-api-access-xdbhb DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/71d315b5-1d7a-43ff-bc1d-a76f5306c665/volumes/kubernetes.io~projected/kube-api-access-zhcz6 DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~projected/kube-api-access-zs8rr DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f781e151-2c24-418f-87be-9047257f37f0/volumes/kubernetes.io~projected/kube-api-access-2vhgc DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c3e3235a5d36b60f51a2141965a485ef0ca66b97b68ccf81ca5a108793aca2b1/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/83af181e-1103-408a-8ac2-b824f97cb619/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cbcec53503aa28b82a8d0cabeebb6ea2b2d54b50d7162be591d465764c93e57f/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7132cf32c85bb730ff497026a5596a5076fadd77dc5470fe08db9deb304b4c65/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d4faa087f2841ea0d112397777bd61cd80af4241733c294540cd836839e5984/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0b7a36419fb78e0 MacAddress:72:70:24:78:91:20 Speed:10000 Mtu:8901} {Name:20f7c4f3fe235e8 MacAddress:ae:a3:b7:38:df:63 Speed:10000 Mtu:8901} {Name:3d4faa087f2841e MacAddress:5e:b9:63:b5:83:a1 Speed:10000 Mtu:8901} {Name:40e829237c8e4e8 MacAddress:6a:68:11:a1:90:cb Speed:10000 Mtu:8901} {Name:62d983938c615cb MacAddress:aa:d3:5f:7f:31:80 Speed:10000 Mtu:8901} {Name:6537f8fc299f393 MacAddress:32:e9:7e:39:d1:a2 Speed:10000 Mtu:8901} {Name:6930265d9088b55 MacAddress:ae:09:95:8b:40:5c Speed:10000 Mtu:8901} {Name:6a4257ad452a194 MacAddress:7a:ea:73:de:43:e4 Speed:10000 Mtu:8901} {Name:8b359b6ba602eb9 MacAddress:96:be:af:06:49:88 Speed:10000 Mtu:8901} {Name:a698450e09db15b MacAddress:0e:3f:7a:d4:25:ac Speed:10000 Mtu:8901} {Name:af0a9aae564308f MacAddress:fe:82:a9:ba:70:6d Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:dc:1c:a1:df Speed:0 Mtu:9001} {Name:br-int MacAddress:66:22:c8:6c:e6:52 Speed:0 Mtu:8901} {Name:c67b4379cf52238 MacAddress:ce:5d:b3:a0:f5:37 Speed:10000 Mtu:8901} {Name:cbcec53503aa28b MacAddress:ce:64:94:e8:81:74 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:dc:1c:a1:df Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:a2:cc:98:04:5a:dc Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:6e:c1:fb:d9:31:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 12:59:38.430988 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.430989    4958 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 12:59:38.431358 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431057    4958 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 12:59:38.431444 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431411    4958 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 12:59:38.431600 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431445    4958 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-236.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 12:59:38.431600 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431625    4958 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 12:59:38.431600 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431634    4958 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 12:59:38.431756 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431647    4958 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 12:59:38.431756 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431661    4958 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 12:59:38.431756 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431685    4958 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 12:59:38.431872 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431862    4958 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 12:59:38.431995 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.431985    4958 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 12:59:38.432036 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432025    4958 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 12:59:38.432069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432041    4958 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 12:59:38.432069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432052    4958 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 12:59:38.432069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432063    4958 kubelet.go:405] "Adding apiserver pod source"
Oct 31 12:59:38.432204 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432071    4958 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 12:59:38.433019 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.432999    4958 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 12:59:38.433019 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.433017    4958 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 12:59:38.433690 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.433667    4958 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 12:59:38.437246 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437229    4958 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 12:59:38.437246 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437243    4958 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 12:59:38.437386 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437349    4958 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 12:59:38.437555 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437543    4958 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 12:59:38.437588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437573    4958 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 12:59:38.437701 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437687    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437705    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437712    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437718    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437724    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437730    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437738    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437743    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437750    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437756    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 12:59:38.437770 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437774    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 12:59:38.438195 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437783    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 12:59:38.438195 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437810    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 12:59:38.438195 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.437816    4958 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 12:59:38.441848 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.441828    4958 server.go:1263] "Started kubelet"
Oct 31 12:59:38.441972 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.441890    4958 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 12:59:38.442029 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.441956    4958 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 12:59:38.442076 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.442040    4958 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 12:59:38.442503 ip-10-0-134-236 systemd[1]: Started Kubernetes Kubelet.
Oct 31 12:59:38.443716 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.443548    4958 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 12:59:38.447475 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.446696    4958 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448428    4958 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448453    4958 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448528    4958 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 12:53:59 +0000 UTC" deadline="2028-05-13 07:44:52.761111002 +0000 UTC"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448571    4958 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h45m14.312545652s"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448591    4958 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448627    4958 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.448778    4958 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.448622    4958 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-236.us-east-2.compute.internal\" not found"
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.449468    4958 factory.go:55] Registering systemd factory
Oct 31 12:59:38.449765 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.449493    4958 factory.go:223] Registration of the systemd container factory successfully
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450283    4958 factory.go:153] Registering CRI-O factory
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450311    4958 factory.go:223] Registration of the crio container factory successfully
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450403    4958 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450435    4958 factory.go:103] Registering Raw factory
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450456    4958 manager.go:1199] Started watching for new ooms in manager
Oct 31 12:59:38.452637 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.450893    4958 manager.go:319] Starting recovery of all containers
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452662    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6129e35b-f819-4c82-9fdf-f51ec2d69bf0" volumeName="kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452705    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd73d4b-84b4-4315-9b73-7e3aa648b9e2" volumeName="kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452720    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" volumeName="kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452733    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452747    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eab4d3aa-6217-475e-afde-5888cc0afd88" volumeName="kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452760    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452773    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71d315b5-1d7a-43ff-bc1d-a76f5306c665" volumeName="kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452786    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cdb8256-bf4d-4bfe-aed0-97643a0151bb" volumeName="kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452800    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f52f053-a1fd-4300-ae84-ed2d1f280da2" volumeName="kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452814    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f52f053-a1fd-4300-ae84-ed2d1f280da2" volumeName="kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452828    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452841    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2777e0-8795-400c-b947-e5d9c5855018" volumeName="kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452853    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452866    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e760ddce-c98f-4300-89ca-78471b37cb1e" volumeName="kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452883    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452897    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3927981d-3a6e-44a0-a152-81798795fa9f" volumeName="kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452911    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452924    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f781e151-2c24-418f-87be-9047257f37f0" volumeName="kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452935    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452948    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7" volumeName="kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452961    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7" volumeName="kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452974    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.452993    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f52f053-a1fd-4300-ae84-ed2d1f280da2" volumeName="kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453006    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcf9a029-b79a-4f07-a747-567708c4d2bc" volumeName="kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453020    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f3a39a10-f9df-4e3e-a387-3d9cc1a58334" volumeName="kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453034    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14" volumeName="kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453047    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14" volumeName="kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453071    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c59aae6f-85e0-4524-8e3d-3b559ad1fdb2" volumeName="kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453090    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 12:59:38.453093 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453102    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f781e151-2c24-418f-87be-9047257f37f0" volumeName="kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453116    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453136    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3927981d-3a6e-44a0-a152-81798795fa9f" volumeName="kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453148    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" volumeName="kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453161    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2777e0-8795-400c-b947-e5d9c5855018" volumeName="kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453175    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e760ddce-c98f-4300-89ca-78471b37cb1e" volumeName="kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453187    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e760ddce-c98f-4300-89ca-78471b37cb1e" volumeName="kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453200    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e" volumeName="kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453213    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" volumeName="kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453224    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453239    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f781e151-2c24-418f-87be-9047257f37f0" volumeName="kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453252    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83af181e-1103-408a-8ac2-b824f97cb619" volumeName="kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453264    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a9b93d3-7770-4815-9ede-5488c17e029f" volumeName="kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453276    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453287    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a30d5a30-8477-4610-a33c-37c17e6b994f" volumeName="kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453298    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0d4dd9c-e5b0-4b63-bcc8-275db18ac571" volumeName="kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453350    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453366    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453379    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eda68c79-68ab-4536-b21d-28c8d819f8a3" volumeName="kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453392    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453406    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3927981d-3a6e-44a0-a152-81798795fa9f" volumeName="kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453419    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="756e459d-0b4a-40ec-a66f-915f2176b815" volumeName="kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453432    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83af181e-1103-408a-8ac2-b824f97cb619" volumeName="kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453445    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2777e0-8795-400c-b947-e5d9c5855018" volumeName="kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453459    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcf9a029-b79a-4f07-a747-567708c4d2bc" volumeName="kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453472    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453485    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453508    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c59aae6f-85e0-4524-8e3d-3b559ad1fdb2" volumeName="kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453520    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c1ddc4d-ce47-4513-a98a-56a711911137" volumeName="kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453544    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="054bc5de-57fb-4e80-9a9e-9e9597cb112c" volumeName="kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453557    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" volumeName="kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453569    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" volumeName="kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453583    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c59aae6f-85e0-4524-8e3d-3b559ad1fdb2" volumeName="kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453595    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e" volumeName="kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453641    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a9b93d3-7770-4815-9ede-5488c17e029f" volumeName="kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453657    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a9b93d3-7770-4815-9ede-5488c17e029f" volumeName="kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453670    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83af181e-1103-408a-8ac2-b824f97cb619" volumeName="kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453683    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c1ddc4d-ce47-4513-a98a-56a711911137" volumeName="kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453696    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1c58f69-b807-48ae-8dca-102c8da839d4" volumeName="kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453712    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" volumeName="kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453725    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc2822c2-f4d2-4b60-be36-8377ff659009" volumeName="kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453739    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33c9fd30-9e88-4bf7-bbf6-6725274a4371" volumeName="kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453753    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a9b93d3-7770-4815-9ede-5488c17e029f" volumeName="kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453767    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e5b53af-d841-4059-a555-4f61e331449d" volumeName="kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453780    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6129e35b-f819-4c82-9fdf-f51ec2d69bf0" volumeName="kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453805    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eda68c79-68ab-4536-b21d-28c8d819f8a3" volumeName="kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453817    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a491af0-7568-4bdd-8a92-8af22ed4b8a2" volumeName="kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453831    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2777e0-8795-400c-b947-e5d9c5855018" volumeName="kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453845    4958 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eab4d3aa-6217-475e-afde-5888cc0afd88" volumeName="kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs" seLinuxMountContext=""
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453856    4958 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 12:59:38.454651 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.453865    4958 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 12:59:38.456910 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.456890    4958 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:38.456971 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.456941    4958 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:38.457336 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.457316    4958 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:38.457810 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.457793    4958 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 12:59:38.471151 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.471128    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:38.477529 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.477504    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:38.479452 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.479413    4958 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 12:59:38.482448 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.482426    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:38.483089 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.483068    4958 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 12:59:38.483184 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.483092    4958 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 12:59:38.483184 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.483115    4958 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 12:59:38.483184 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.483153    4958 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 12:59:38.488526 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.488499    4958 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 12:59:38.491756 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.491732    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:38.499060 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499032    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="9306910ae8dbc62145adf167a41df426c83de91af3f5c106a67acb4cecf1bf41" exitCode=0
Oct 31 12:59:38.499142 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499061    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="c28bbd4288bc8910592cd62c70cc9913f9dc705c371a5373621b2e80de311482" exitCode=0
Oct 31 12:59:38.499142 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499072    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="34e32abb516f5f41f27e8e5f02bb033f35b2d8a7ad93b51ee62dda7585d56db7" exitCode=0
Oct 31 12:59:38.499142 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499081    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="ca1551ee54c8ed2616fc34419a8bd830c54192e8a4f11f603f1e159eea283e3a" exitCode=0
Oct 31 12:59:38.499142 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499090    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="c4b68ee44e85aeaad88e96baaf7a7807815ea90838be01061c0cbed1fa71ee77" exitCode=0
Oct 31 12:59:38.499142 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.499099    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab2777e0-8795-400c-b947-e5d9c5855018" containerID="d28d5b24e47d8acf5d0c6053d7833ecd188526dd99e2b7fae2d78db57f404002" exitCode=0
Oct 31 12:59:38.518195 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.518136    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 12:59:38.518492 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.518470    4958 generic.go:356] "Generic (PLEG): container finished" podID="9a6a0aef-64f6-4163-8d5c-caf1f57f93dd" containerID="7dec866e6b9b9f8634188328f625498bf5dc1f687ac363e6790d47d3f66f61d1" exitCode=1
Oct 31 12:59:38.520327 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.520306    4958 generic.go:356] "Generic (PLEG): container finished" podID="171d70015aed926fef2166fbf48d78ef" containerID="b16b53129d4a844b1378bb409318fe74030e532ef8e325a3e5c4fa3f5c9cbec5" exitCode=0
Oct 31 12:59:38.530153 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.530129    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:38.530247 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.530162    4958 generic.go:356] "Generic (PLEG): container finished" podID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460" exitCode=255
Oct 31 12:59:38.543579 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.543562    4958 manager.go:324] Recovery completed
Oct 31 12:59:38.564241 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564220    4958 cpu_manager.go:226] "Starting" policy="none"
Oct 31 12:59:38.564241 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564235    4958 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 12:59:38.564373 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564252    4958 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 12:59:38.564373 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564364    4958 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564375    4958 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564392    4958 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564397    4958 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564402    4958 policy_none.go:50] "Start"
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564410    4958 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 12:59:38.564430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564427    4958 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 12:59:38.564590 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564548    4958 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 12:59:38.564590 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564554    4958 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 12:59:38.564590 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.564560    4958 policy_none.go:44] "Start"
Oct 31 12:59:38.568936 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.568910    4958 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 12:59:38.571615 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.571595    4958 manager.go:341] "Starting Device Plugin manager"
Oct 31 12:59:38.572078 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.571631    4958 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 12:59:38.572125 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572080    4958 server.go:87] "Starting device plugin registration server"
Oct 31 12:59:38.572330 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572320    4958 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 12:59:38.572370 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572332    4958 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 12:59:38.572476 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572442    4958 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 12:59:38.572588 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572549    4958 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 12:59:38.572712 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572595    4958 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 12:59:38.572712 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572616    4958 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 12:59:38.572818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.572670    4958 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T12:59:38.572583939Z","UUID":"324c12c6-a10b-4bd1-8638-629aae47bfae","Handler":null,"Name":"","Endpoint":""}
Oct 31 12:59:38.574181 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.574153    4958 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 12:59:38.574282 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.574196    4958 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 12:59:38.574282 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.574229    4958 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 12:59:38.583238 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.583198    4958 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"]
Oct 31 12:59:38.583895 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.583873    4958 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.583995 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.583872    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"3b35a27b51fd2e2aa7686bff71c7e43c","Type":"ContainerStarted","Data":"39e0ba197f1c6e694a4962dca4286d33d336f5aa020e1c1d5d801092e7b89679"}
Oct 31 12:59:38.584057 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.583993    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"3b35a27b51fd2e2aa7686bff71c7e43c","Type":"ContainerStarted","Data":"7787d4148fdd292ef53dd6896e8979f238dff6a8dd55bb4cff78dd55628dcfc9"}
Oct 31 12:59:38.584057 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.584049    4958 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.584057 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.584056    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerStarted","Data":"2319edfd3df72ca4c322f0dcc49ed13f3ce810328c9bc8c4716370ade13a9574"}
Oct 31 12:59:38.584231 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.584074    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerDied","Data":"b16b53129d4a844b1378bb409318fe74030e532ef8e325a3e5c4fa3f5c9cbec5"}
Oct 31 12:59:38.584231 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.584089    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal" event={"ID":"171d70015aed926fef2166fbf48d78ef","Type":"ContainerStarted","Data":"d9ee35b004d7dad25e2c918895f8e38b8b8d6bdb2b258741890f0a2bcfd25b00"}
Oct 31 12:59:38.598688 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.598662    4958 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:59:38.598816 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.598712    4958 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.599367 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.599345    4958 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:59:38.599466 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:38.599392    4958 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.659367 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.659330    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.659367 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.659365    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.659580 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.659390    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.673446 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.673418    4958 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 12:59:38.674799 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.674777    4958 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 12:59:38.674909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.674809    4958 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 12:59:38.674909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.674820    4958 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-236.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 12:59:38.674909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.674862    4958 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.688510 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.688486    4958 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.688600 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.688554    4958 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759774 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759740    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759774 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759685    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759975 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759820    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759975 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759847    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759975 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759883    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b35a27b51fd2e2aa7686bff71c7e43c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"3b35a27b51fd2e2aa7686bff71c7e43c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:38.759975 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:38.759934    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171d70015aed926fef2166fbf48d78ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" (UID: \"171d70015aed926fef2166fbf48d78ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:39.433183 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.433091    4958 apiserver.go:52] "Watching apiserver"
Oct 31 12:59:39.443650 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.443596    4958 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 12:59:39.446289 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.446231    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8b4lq","openshift-multus/network-metrics-daemon-6wvpk","kube-system/kas-connection-checker-685895c7c9-7z2j5","openshift-console-operator/console-operator-7cd56b8dbc-jvcw2","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2","openshift-ingress-canary/ingress-canary-9tlqt","openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz","openshift-multus/multus-89tnj","openshift-network-diagnostics/network-check-target-m7269","openshift-image-registry/image-registry-bfbbb8f8d-6rp4v","openshift-image-registry/node-ca-pdgpg","kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2","openshift-dns/dns-default-8qxn7","kube-system/global-pull-secret-syncer-jg2rt","kube-system/kas-connection-checker-685895c7c9-xdvkn","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq","openshift-network-operator/iptables-alerter-zg58k","kube-system/kas-connection-checker-685895c7c9-z76m8","openshift-insights/insights-operator-7c4986d449-ffdc6","openshift-ingress/router-default-64f9757499-rkffd","openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f","openshift-multus/multus-additional-cni-plugins-mmtt5","openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m","openshift-insights/insights-runtime-extractor-mq875","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc","openshift-cluster-node-tuning-operator/tuned-22fmx","openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh","openshift-dns/node-resolver-xfkgh","openshift-network-console/networking-console-plugin-86c478bb88-pn27v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-7p44t","openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 12:59:39.448101 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.448080    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.448931 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.448909    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.449631 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.449598    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.451138 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.451118    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.451565 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.451549    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:39.452922 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.452903    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 12:59:39.453025 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.452997    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:39.453491 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453468    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 12:59:39.453695 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453670    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 12:59:39.453844 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453824    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.453844 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453835    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453845    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453867    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453897    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453924    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453947    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453979    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.453995    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.454006 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454001    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 12:59:39.454289 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454015    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.454289 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454271    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.454729 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454708    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.454729 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454724    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.454989 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454710    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 12:59:39.454989 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454757    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 12:59:39.454989 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454967    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.454994    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455002    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455007    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455018    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455095    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.455220 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455203    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.455458 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455234    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.455458 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455260    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.455458 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455433    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 12:59:39.455680 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.455666    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 12:59:39.457441 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.457416    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 12:59:39.459663 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.459637    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 12:59:39.459760 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.459748    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 12:59:39.459824 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.459811    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 12:59:39.459964 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.459950    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-g22bl\""
Oct 31 12:59:39.460171 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.460155    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.460251 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.460238    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.460355 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.460342    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.460841 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.460817    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.461065 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461045    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 12:59:39.461065 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461058    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.461189 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461105    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5b9kz\""
Oct 31 12:59:39.461260 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461217    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 12:59:39.461311 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461276    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.461740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461453    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 12:59:39.461816 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461765    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 12:59:39.461816 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461796    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 12:59:39.461997 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.461980    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.462061 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462043    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.462341 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462324    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.462407 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462336    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 12:59:39.462407 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462354    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 12:59:39.462493 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462417    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lsjfn\""
Oct 31 12:59:39.462493 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462477    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 12:59:39.462593 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462571    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.462740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462645    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7lhn5\""
Oct 31 12:59:39.462740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462670    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 12:59:39.462740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462686    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 12:59:39.462740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462714    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 12:59:39.462740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462732    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462734    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwtqn\""
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462779    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462792    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462795    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462831    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccxf\" (UniqueName: \"kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf\") pod \"volume-data-source-validator-58c9f5f46d-gkjn2\" (UID: \"054bc5de-57fb-4e80-9a9e-9e9597cb112c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462865    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhcz6\" (UniqueName: \"kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6\") pod \"kas-connection-checker-685895c7c9-z76m8\" (UID: \"71d315b5-1d7a-43ff-bc1d-a76f5306c665\") " pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462892    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462920    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6ktk\" (UniqueName: \"kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk\") pod \"kas-connection-checker-685895c7c9-7z2j5\" (UID: \"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2\") " pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462951    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.462985    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8rr\" (UniqueName: \"kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.463015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463011    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kkl8\" (UniqueName: \"kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463035    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463060    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbhb\" (UniqueName: \"kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463085    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463111    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463136    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463162    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463189    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78p8\" (UniqueName: \"kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463276    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4cp5\" (UniqueName: \"kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5\") pod \"kas-connection-checker-685895c7c9-xdvkn\" (UID: \"8a491af0-7568-4bdd-8a92-8af22ed4b8a2\") " pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463301    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463319    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463335    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463352    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463415    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f52f053-a1fd-4300-ae84-ed2d1f280da2-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.463622 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463555    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463651    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-config\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463715    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463723    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f52f053-a1fd-4300-ae84-ed2d1f280da2-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463781    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-stats-auth\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463930    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-default-certificate\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.463996    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a9b93d3-7770-4815-9ede-5488c17e029f-serving-cert\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.464341    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a9b93d3-7770-4815-9ede-5488c17e029f-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.464401 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.464386    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.464911 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.464878    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 12:59:39.464996 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.464925    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 12:59:39.464996 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.464958    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2xlcn\""
Oct 31 12:59:39.465713 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.465700    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.465844 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.465829    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drb8j\""
Oct 31 12:59:39.466430 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466411    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.466548 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466442    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 12:59:39.466548 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466506    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 12:59:39.466548 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466516    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 12:59:39.466548 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466536    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466548    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466549    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-2x4wq\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466554    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466592    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466595    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466629    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466636    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lt4jt\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466677    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtxsh\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466683    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kvxk\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466694    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466722    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-64mjv\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466746    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mw6wr\""
Oct 31 12:59:39.466818 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466771    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.467166 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.466986    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.467756 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.467737    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 12:59:39.467825 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.467764    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gth9v\""
Oct 31 12:59:39.467825 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.467813    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.467905 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.467836    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 12:59:39.468336 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468321    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 12:59:39.468405 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468325    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ftfm5\""
Oct 31 12:59:39.468405 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468372    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lmj6s\""
Oct 31 12:59:39.468591 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468579    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 12:59:39.468647 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468631    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 12:59:39.468691 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.468679    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 12:59:39.470852 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.470841    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 12:59:39.471241 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.471230    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qpv6m\""
Oct 31 12:59:39.473687 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.473668    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhcz6\" (UniqueName: \"kubernetes.io/projected/71d315b5-1d7a-43ff-bc1d-a76f5306c665-kube-api-access-zhcz6\") pod \"kas-connection-checker-685895c7c9-z76m8\" (UID: \"71d315b5-1d7a-43ff-bc1d-a76f5306c665\") " pod="kube-system/kas-connection-checker-685895c7c9-z76m8"
Oct 31 12:59:39.473753 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.473711    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccxf\" (UniqueName: \"kubernetes.io/projected/054bc5de-57fb-4e80-9a9e-9e9597cb112c-kube-api-access-mccxf\") pod \"volume-data-source-validator-58c9f5f46d-gkjn2\" (UID: \"054bc5de-57fb-4e80-9a9e-9e9597cb112c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-gkjn2"
Oct 31 12:59:39.473814 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.473798    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kkl8\" (UniqueName: \"kubernetes.io/projected/9f52f053-a1fd-4300-ae84-ed2d1f280da2-kube-api-access-4kkl8\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2\" (UID: \"9f52f053-a1fd-4300-ae84-ed2d1f280da2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2"
Oct 31 12:59:39.476553 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.476529    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8rr\" (UniqueName: \"kubernetes.io/projected/83af181e-1103-408a-8ac2-b824f97cb619-kube-api-access-zs8rr\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.476684 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.476666    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78p8\" (UniqueName: \"kubernetes.io/projected/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-kube-api-access-l78p8\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.476874 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.476859    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6ktk\" (UniqueName: \"kubernetes.io/projected/6bd73d4b-84b4-4315-9b73-7e3aa648b9e2-kube-api-access-f6ktk\") pod \"kas-connection-checker-685895c7c9-7z2j5\" (UID: \"6bd73d4b-84b4-4315-9b73-7e3aa648b9e2\") " pod="kube-system/kas-connection-checker-685895c7c9-7z2j5"
Oct 31 12:59:39.476972 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.476953    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4cp5\" (UniqueName: \"kubernetes.io/projected/8a491af0-7568-4bdd-8a92-8af22ed4b8a2-kube-api-access-b4cp5\") pod \"kas-connection-checker-685895c7c9-xdvkn\" (UID: \"8a491af0-7568-4bdd-8a92-8af22ed4b8a2\") " pod="kube-system/kas-connection-checker-685895c7c9-xdvkn"
Oct 31 12:59:39.477118 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.477099    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbhb\" (UniqueName: \"kubernetes.io/projected/1a9b93d3-7770-4815-9ede-5488c17e029f-kube-api-access-xdbhb\") pod \"console-operator-7cd56b8dbc-jvcw2\" (UID: \"1a9b93d3-7770-4815-9ede-5488c17e029f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:39.533446 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.533413    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:39.538140 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.538117    4958 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:39.538258 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.538240    4958 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:39.550008 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.549982    4958 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:59:39.550136 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.550025    4958 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:39.551049 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.551026    4958 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 12:59:39.551155 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.551142    4958 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 12:59:39.551217 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.551175    4958 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-236.us-east-2.compute.internal"
Oct 31 12:59:39.564407 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564386    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.564455 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564415    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:39.564455 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564433    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.564455 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564449    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.564575 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564464    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.564575 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564528    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.564575 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564555    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.564687 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564577    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.564687 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564672    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.564803 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564785    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.564863 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564820    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.564909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564864    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vt65\" (UniqueName: \"kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.564909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564870    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-cni-binary-copy\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.564909 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564894    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f781e151-2c24-418f-87be-9047257f37f0-multus-daemon-config\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.565045 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564908    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eab4d3aa-6217-475e-afde-5888cc0afd88-agent-certs\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:39.565045 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564908    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.565045 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.564983    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.565045 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565022    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwshp\" (UniqueName: \"kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.565199 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565049    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.565248 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565193    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.565248 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565243    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:39.565322 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565269    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g27dp\" (UniqueName: \"kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.565322 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565285    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p88h\" (UniqueName: \"kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.565418 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565344    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.565418 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565371    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxwh\" (UniqueName: \"kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.565500 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565435    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.565500 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565445    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcf9a029-b79a-4f07-a747-567708c4d2bc-cert\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:39.565500 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565465    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.565500 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565496    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565521    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565550    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565550    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3927981d-3a6e-44a0-a152-81798795fa9f-tmp-dir\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565575    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565626    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565642    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565649    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565665    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbhx\" (UniqueName: \"kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx\") pod \"migrator-66df5d496b-qdk4f\" (UID: \"9cdb8256-bf4d-4bfe-aed0-97643a0151bb\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565684    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565701    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.565724 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565718    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565732    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565775    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565804    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w8s\" (UniqueName: \"kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565820    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565832    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565860    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565866    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565947    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565970    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.565985    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566001    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566016    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566020    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-serviceca\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566055    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566089    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566127    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566144    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.566201 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566184    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566272    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566300    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566326    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566314    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab2777e0-8795-400c-b947-e5d9c5855018-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566355    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566367    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-data-volume\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566387    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.566424    4958 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566475    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.566548    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.066525322 +0000 UTC m=+1.729951009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566574    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566596    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566650    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdmb\" (UniqueName: \"kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566745    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e5b53af-d841-4059-a555-4f61e331449d-original-pull-secret\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566815    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzxl\" (UniqueName: \"kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.566852    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:39.566928 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.566898    4958 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.566941    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.066930103 +0000 UTC m=+1.730355796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567001    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvdj\" (UniqueName: \"kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567032    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567056    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567106    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567132    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567159    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567186    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567218    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567240    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567259    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567273    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.567292    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.067274914 +0000 UTC m=+1.730700593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567322    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xp2f\" (UniqueName: \"kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567407    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-tmp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567431    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567448    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567449    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3927981d-3a6e-44a0-a152-81798795fa9f-config-volume\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567465    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567483    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567536    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567569    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567659    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eab4d3aa-6217-475e-afde-5888cc0afd88-konnectivity-ca\") pod \"konnectivity-agent-8b4lq\" (UID: \"eab4d3aa-6217-475e-afde-5888cc0afd88\") " pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567701    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567706    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovn-node-metrics-cert\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.567748 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567745    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567780    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567798    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567812    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567817    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567835    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567852    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567873    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.567972    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568001    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568035    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568063    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhgc\" (UniqueName: \"kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568081    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda68c79-68ab-4536-b21d-28c8d819f8a3-tmp-dir\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568091    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lkgw\" (UniqueName: \"kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568120    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2hk\" (UniqueName: \"kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568183    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568290    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568352    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568380    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568405    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568421    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568437    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568459    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568482    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-env-overrides\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568507    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-config\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568544    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-tmp\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.568562 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568547    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568594    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568599    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-tuned\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568627    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568641    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-serving-cert\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568648    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568668    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568668    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-ovnkube-script-lib\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568687    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568704    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568747    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568794    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568838    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568859    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568875    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568879    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568891    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.568983    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569017    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569034    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569051    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569066    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-service-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569074    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569080    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569117    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc2822c2-f4d2-4b60-be36-8377ff659009-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569122    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569166    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c1ddc4d-ce47-4513-a98a-56a711911137-iptables-alerter-script\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569182    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569189    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569282    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569304    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569329    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569358    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569374    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-config\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569378    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569417    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569438    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569458    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cc2822c2-f4d2-4b60-be36-8377ff659009-serving-cert\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569457    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569487    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znwwq\" (UniqueName: \"kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569514    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cc2822c2-f4d2-4b60-be36-8377ff659009-snapshots\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569629    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkx2\" (UniqueName: \"kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569649    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569653    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569664    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.569737 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.569682    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftpg\" (UniqueName: \"kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg\") pod \"network-check-source-6f78d59f99-h2pxh\" (UID: \"756e459d-0b4a-40ec-a66f-915f2176b815\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:39.581174 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581148    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxwh\" (UniqueName: \"kubernetes.io/projected/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-kube-api-access-5bxwh\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.581373 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581356    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g27dp\" (UniqueName: \"kubernetes.io/projected/3927981d-3a6e-44a0-a152-81798795fa9f-kube-api-access-g27dp\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.581676 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581659    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbhx\" (UniqueName: \"kubernetes.io/projected/9cdb8256-bf4d-4bfe-aed0-97643a0151bb-kube-api-access-drbhx\") pod \"migrator-66df5d496b-qdk4f\" (UID: \"9cdb8256-bf4d-4bfe-aed0-97643a0151bb\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qdk4f"
Oct 31 12:59:39.581751 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581690    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w8s\" (UniqueName: \"kubernetes.io/projected/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-kube-api-access-w4w8s\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.581939 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581925    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzxl\" (UniqueName: \"kubernetes.io/projected/c59aae6f-85e0-4524-8e3d-3b559ad1fdb2-kube-api-access-tlzxl\") pod \"service-ca-operator-544d749c8c-z9v9m\" (UID: \"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m"
Oct 31 12:59:39.581973 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.581947    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdmb\" (UniqueName: \"kubernetes.io/projected/cc2822c2-f4d2-4b60-be36-8377ff659009-kube-api-access-lkdmb\") pod \"insights-operator-7c4986d449-ffdc6\" (UID: \"cc2822c2-f4d2-4b60-be36-8377ff659009\") " pod="openshift-insights/insights-operator-7c4986d449-ffdc6"
Oct 31 12:59:39.582091 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.582077    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p88h\" (UniqueName: \"kubernetes.io/projected/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-api-access-8p88h\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.582448 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.582426    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwshp\" (UniqueName: \"kubernetes.io/projected/e760ddce-c98f-4300-89ca-78471b37cb1e-kube-api-access-mwshp\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.591062 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591026    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.591186 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591166    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvdj\" (UniqueName: \"kubernetes.io/projected/8c1ddc4d-ce47-4513-a98a-56a711911137-kube-api-access-qnvdj\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.591465 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591442    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znwwq\" (UniqueName: \"kubernetes.io/projected/a30d5a30-8477-4610-a33c-37c17e6b994f-kube-api-access-znwwq\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:39.591559 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591493    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.591559 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591497    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8gr\" (UniqueName: \"kubernetes.io/projected/e1c58f69-b807-48ae-8dca-102c8da839d4-kube-api-access-ns8gr\") pod \"network-check-target-m7269\" (UID: \"e1c58f69-b807-48ae-8dca-102c8da839d4\") " pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:39.591784 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.591736    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xp2f\" (UniqueName: \"kubernetes.io/projected/eda68c79-68ab-4536-b21d-28c8d819f8a3-kube-api-access-2xp2f\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.592059 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592038    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftpg\" (UniqueName: \"kubernetes.io/projected/756e459d-0b4a-40ec-a66f-915f2176b815-kube-api-access-7ftpg\") pod \"network-check-source-6f78d59f99-h2pxh\" (UID: \"756e459d-0b4a-40ec-a66f-915f2176b815\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h2pxh"
Oct 31 12:59:39.592187 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592166    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkx2\" (UniqueName: \"kubernetes.io/projected/ab2777e0-8795-400c-b947-e5d9c5855018-kube-api-access-9wkx2\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.592230 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592167    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vt65\" (UniqueName: \"kubernetes.io/projected/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-kube-api-access-5vt65\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.592294 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592272    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.592357 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592342    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.592392 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.592370    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhgc\" (UniqueName: \"kubernetes.io/projected/f781e151-2c24-418f-87be-9047257f37f0-kube-api-access-2vhgc\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.593322 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.593306    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lkgw\" (UniqueName: \"kubernetes.io/projected/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kube-api-access-6lkgw\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.597195 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.597179    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2hk\" (UniqueName: \"kubernetes.io/projected/dcf9a029-b79a-4f07-a747-567708c4d2bc-kube-api-access-mr2hk\") pod \"ingress-canary-9tlqt\" (UID: \"dcf9a029-b79a-4f07-a747-567708c4d2bc\") " pod="openshift-ingress-canary/ingress-canary-9tlqt"
Oct 31 12:59:39.670169 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670139    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.670169 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670172    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670196    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670221    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670249    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670276    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670305    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670334    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670337    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-k8s-cni-cncf-io\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670341    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-registration-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670358    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670356    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eda68c79-68ab-4536-b21d-28c8d819f8a3-hosts-file\") pod \"node-resolver-xfkgh\" (UID: \"eda68c79-68ab-4536-b21d-28c8d819f8a3\") " pod="openshift-dns/node-resolver-xfkgh"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670279    4958 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670417    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-systemd\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670441    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-cnibin\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670459    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.170439147 +0000 UTC m=+1.833864827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670482    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670508    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-kubelet-config\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670484    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-cnibin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670294    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670539    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-ovn\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670549    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670592    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.170581104 +0000 UTC m=+1.834006808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670511    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670629    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-multus\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670651    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670675    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670698    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670720    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670726    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e5b53af-d841-4059-a555-4f61e331449d-dbus\") pod \"global-pull-secret-syncer-jg2rt\" (UID: \"4e5b53af-d841-4059-a555-4f61e331449d\") " pod="kube-system/global-pull-secret-syncer-jg2rt"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670744    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670765    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-netns\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670782    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670793    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-modprobe-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670805    4958 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670811    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-log-socket\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.670860    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.170845351 +0000 UTC m=+1.834271020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670860    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-system-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670807    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670901    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670918    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670943    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-conf\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.670926 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670956    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.670981    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-socket-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671014    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671048    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671065    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671080    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671103    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671117    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-systemd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671127    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-var-lib-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671104    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-etc-kubernetes\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671129    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671158    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c1ddc4d-ce47-4513-a98a-56a711911137-host-slash\") pod \"iptables-alerter-zg58k\" (UID: \"8c1ddc4d-ce47-4513-a98a-56a711911137\") " pod="openshift-network-operator/iptables-alerter-zg58k"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671167    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-sys-fs\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671187    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671191    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671220    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671244    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671269    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671279    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14-host\") pod \"node-ca-pdgpg\" (UID: \"b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14\") " pod="openshift-image-registry/node-ca-pdgpg"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671292    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671300    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671307    4958 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671315    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671342    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671354    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671359    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-run-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671365    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671366    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671384    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.17137184 +0000 UTC m=+1.834797507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671386    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-cni-bin\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671353    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-netns\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671409    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.17139979 +0000 UTC m=+1.834825454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671412    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-run\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671427    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671450    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671467    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-system-cni-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671467    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671494    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671504    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-cni-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671515    4958 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671533    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671538    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-node-log\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.671550    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.171536878 +0000 UTC m=+1.834962552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : secret "metrics-daemon-secret" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671514    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-netd\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671581    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671616    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671642    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671648    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-var-lib-kubelet\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671687    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-systemd-units\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671698    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2777e0-8795-400c-b947-e5d9c5855018-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmtt5\" (UID: \"ab2777e0-8795-400c-b947-e5d9c5855018\") " pod="openshift-multus/multus-additional-cni-plugins-mmtt5"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671708    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671742    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671777    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671802    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671830    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671865    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysconfig\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671870    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-hostroot\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671878    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-cni-bin\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671871    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671910    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-device-dir\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671911    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0d4dd9c-e5b0-4b63-bcc8-275db18ac571-etc-selinux\") pod \"aws-ebs-csi-driver-node-55kjc\" (UID: \"c0d4dd9c-e5b0-4b63-bcc8-275db18ac571\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55kjc"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671921    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.671972    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-sys\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672000    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672023    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672041    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672056    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672065    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-conf-dir\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672074    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672100    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672102    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-host\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672116    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-kubelet\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672124    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672149    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-kubernetes\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672151    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672151    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-run-multus-certs\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672181    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672179    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-etc-sysctl-d\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.672220    4958 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672225    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672246    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e760ddce-c98f-4300-89ca-78471b37cb1e-lib-modules\") pod \"tuned-22fmx\" (UID: \"e760ddce-c98f-4300-89ca-78471b37cb1e\") " pod="openshift-cluster-node-tuning-operator/tuned-22fmx"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672255    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672282    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672297    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-host-var-lib-kubelet\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672296    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-host-slash\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:39.672312    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:40.172294983 +0000 UTC m=+1.835720664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672328    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672345    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.672406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672313    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a6a0aef-64f6-4163-8d5c-caf1f57f93dd-etc-openvswitch\") pod \"ovnkube-node-7p44t\" (UID: \"9a6a0aef-64f6-4163-8d5c-caf1f57f93dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:39.674767 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672416    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f781e151-2c24-418f-87be-9047257f37f0-multus-socket-dir-parent\") pod \"multus-89tnj\" (UID: \"f781e151-2c24-418f-87be-9047257f37f0\") " pod="openshift-multus/multus-89tnj"
Oct 31 12:59:39.674767 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.672451    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-crio-socket\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:39.749439 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:39.749404    4958 scope.go:122] "RemoveContainer" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"
Oct 31 12:59:40.076912 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.076798    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:40.076912 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.076869    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:40.077129 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.076967    4958 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:40.077129 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.076995    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.076972175 +0000 UTC m=+2.740397857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:40.077129 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.077053    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.0770359 +0000 UTC m=+2.740461584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:40.077233 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.077221    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:40.077338 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.077323    4958 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:40.077383 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.077370    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.077358561 +0000 UTC m=+2.740784223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:40.177917 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.177882    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.177926    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.177947    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.177990    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178044    4958 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.178057    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:40.178088 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.178088    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178098    4958 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178046    4958 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178146    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178151    4958 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178158    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178098    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178191    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178107    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178091354 +0000 UTC m=+2.841517037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178240    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178209498 +0000 UTC m=+2.841635165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178262    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178251288 +0000 UTC m=+2.841676952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178301    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178280092 +0000 UTC m=+2.841705755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178338    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178322173 +0000 UTC m=+2.841747836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:40.178373 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178360    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178351136 +0000 UTC m=+2.841776802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:40.178773 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.178402    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:40.178773 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178499    4958 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 12:59:40.178773 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.178577    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:41.178569695 +0000 UTC m=+2.841995375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : secret "metrics-daemon-secret" not found
Oct 31 12:59:40.542968 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.542938    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 12:59:40.543406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.543391    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/1.log"
Oct 31 12:59:40.543465 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.543426    4958 generic.go:356] "Generic (PLEG): container finished" podID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerID="fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0" exitCode=255
Oct 31 12:59:40.543537 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.543511    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerDied","Data":"fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0"}
Oct 31 12:59:40.543593 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.543580    4958 scope.go:122] "RemoveContainer" containerID="4c0ed387a90745765014684d13329af9b94d9551cd692c47326071fef0fce460"
Oct 31 12:59:40.544058 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:40.544038    4958 scope.go:122] "RemoveContainer" containerID="fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0"
Oct 31 12:59:40.544221 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:40.544196    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:41.088278 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.088243    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:41.088446 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.088290    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:41.088446 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.088311    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:41.088446 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.088414    4958 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 12:59:41.088631 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.088430    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.088417028 +0000 UTC m=+4.751842706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:41.088631 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.088502    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.088484491 +0000 UTC m=+4.751910157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : secret "router-metrics-certs-default" not found
Oct 31 12:59:41.088631 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.088544    4958 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:41.088631 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.088622    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.088590013 +0000 UTC m=+4.752015692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:41.189520 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189476    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:41.189520 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189524    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189569    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189592    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189630    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189652    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189675    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189677    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189720    4958 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189737    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189718887 +0000 UTC m=+4.853144566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189767    4958 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189772    4958 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189779    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs podName:a30d5a30-8477-4610-a33c-37c17e6b994f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189762307 +0000 UTC m=+4.853187996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs") pod "network-metrics-daemon-6wvpk" (UID: "a30d5a30-8477-4610-a33c-37c17e6b994f") : secret "metrics-daemon-secret" not found
Oct 31 12:59:41.189795 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189723    4958 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189830    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189841    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189843    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189830102 +0000 UTC m=+4.853255766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189860    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls podName:f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189851435 +0000 UTC m=+4.853277103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-4xpsq" (UID: "f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e") : secret "samples-operator-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.189839    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189877    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189868947 +0000 UTC m=+4.853294611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189890    4958 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189908    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189890894 +0000 UTC m=+4.853316560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:41.190153 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.189923    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert podName:f3a39a10-f9df-4e3e-a387-3d9cc1a58334 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:43.189917431 +0000 UTC m=+4.853343095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pn27v" (UID: "f3a39a10-f9df-4e3e-a387-3d9cc1a58334") : secret "networking-console-plugin-cert" not found
Oct 31 12:59:41.215096 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.215075    4958 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:41.549807 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.549753    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:41.551534 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.551512    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 12:59:41.551866 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.551852    4958 scope.go:122] "RemoveContainer" containerID="fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0"
Oct 31 12:59:41.552059 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:41.552041    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:41.678863 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.678830    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:41.820883 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:41.820770    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:42.010052 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:42.010019    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:42.481032 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:42.480996    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:43.107487 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.107444    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.107496    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.107526    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.107600    4958 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.107697    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.107681019 +0000 UTC m=+8.771106700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.107724    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle podName:83af181e-1103-408a-8ac2-b824f97cb619 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.107709859 +0000 UTC m=+8.771135540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle") pod "router-default-64f9757499-rkffd" (UID: "83af181e-1103-408a-8ac2-b824f97cb619") : configmap references non-existent config key: service-ca.crt
Oct 31 12:59:43.107932 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.107839    4958 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 12:59:43.110055 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.110034    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83af181e-1103-408a-8ac2-b824f97cb619-metrics-certs\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:43.160194 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.160154    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:43.208453 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208411    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:43.208453 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208461    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208481    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208528    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208582    4958 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208650    4958 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208664    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls podName:6129e35b-f819-4c82-9fdf-f51ec2d69bf0 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.208646922 +0000 UTC m=+8.872072603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mq875" (UID: "6129e35b-f819-4c82-9fdf-f51ec2d69bf0") : secret "insights-runtime-extractor-tls" not found
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208683    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.208673775 +0000 UTC m=+8.872099444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208681    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:43.208709 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208705    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208751    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.208738859 +0000 UTC m=+8.872164523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208701    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208801    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.208832    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208932    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.208949    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:43.209069 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:43.209012    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:47.208994776 +0000 UTC m=+8.872420453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:43.210929 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.210904    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a30d5a30-8477-4610-a33c-37c17e6b994f-metrics-certs\") pod \"network-metrics-daemon-6wvpk\" (UID: \"a30d5a30-8477-4610-a33c-37c17e6b994f\") " pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:43.211045 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.211028    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3a39a10-f9df-4e3e-a387-3d9cc1a58334-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pn27v\" (UID: \"f3a39a10-f9df-4e3e-a387-3d9cc1a58334\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:43.211190 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.211172    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-4xpsq\" (UID: \"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:43.350381 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.350350    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"
Oct 31 12:59:43.352268 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.352247    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v"
Oct 31 12:59:43.353273 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.353252    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wvpk"
Oct 31 12:59:43.369621 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.369585    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:43.569546 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.569512    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:43.636792 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.636713    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pn27v"]
Oct 31 12:59:43.637172 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.637154    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wvpk"]
Oct 31 12:59:43.639906 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:43.639879    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a39a10_f9df_4e3e_a387_3d9cc1a58334.slice/crio-8187e32f21bc436dd7ba90d037be550b3fddbaa309f65b941a9e5e548fcf1659 WatchSource:0}: Error finding container 8187e32f21bc436dd7ba90d037be550b3fddbaa309f65b941a9e5e548fcf1659: Status 404 returned error can't find the container with id 8187e32f21bc436dd7ba90d037be550b3fddbaa309f65b941a9e5e548fcf1659
Oct 31 12:59:43.640190 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.640174    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq"]
Oct 31 12:59:43.640741 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:43.640722    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30d5a30_8477_4610_a33c_37c17e6b994f.slice/crio-ca94bd1a2d1822497c32812a24e82b02db88afb4e960cf4df401acdb8e63ff87 WatchSource:0}: Error finding container ca94bd1a2d1822497c32812a24e82b02db88afb4e960cf4df401acdb8e63ff87: Status 404 returned error can't find the container with id ca94bd1a2d1822497c32812a24e82b02db88afb4e960cf4df401acdb8e63ff87
Oct 31 12:59:43.642277 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.642260    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 12:59:43.654351 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.654335    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xfkgh_eda68c79-68ab-4536-b21d-28c8d819f8a3/dns-node-resolver/0.log"
Oct 31 12:59:43.765523 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.765489    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:43.965097 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:43.965070    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:44.455539 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:44.455193    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdgpg_b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14/node-ca/0.log"
Oct 31 12:59:44.565210 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:44.565174    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wvpk" event={"ID":"a30d5a30-8477-4610-a33c-37c17e6b994f","Type":"ContainerStarted","Data":"ca94bd1a2d1822497c32812a24e82b02db88afb4e960cf4df401acdb8e63ff87"}
Oct 31 12:59:44.568135 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:44.568102    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v" event={"ID":"f3a39a10-f9df-4e3e-a387-3d9cc1a58334","Type":"ContainerStarted","Data":"8187e32f21bc436dd7ba90d037be550b3fddbaa309f65b941a9e5e548fcf1659"}
Oct 31 12:59:44.569561 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:44.569492    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq" event={"ID":"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e","Type":"ContainerStarted","Data":"36df1735042ccbbdab1d1d719e467a8348fa0ce9d43a7e89ecaaf58f290f2529"}
Oct 31 12:59:45.055642 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.055591    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9tlqt_dcf9a029-b79a-4f07-a747-567708c4d2bc/serve-healthcheck-canary/0.log"
Oct 31 12:59:45.172956 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.172879    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:45.376673 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.376638    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:45.569449 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.569407    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:45.574266 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.574234    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wvpk" event={"ID":"a30d5a30-8477-4610-a33c-37c17e6b994f","Type":"ContainerStarted","Data":"e1c95db3226d6dfe58330630f78cbbb87ec261f3834ad379ccae4e4d2c66ba48"}
Oct 31 12:59:45.574426 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.574298    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wvpk" event={"ID":"a30d5a30-8477-4610-a33c-37c17e6b994f","Type":"ContainerStarted","Data":"dcbafc2e66eb520e77c63cc99abb1f4640410eeadc1ef85a4dba31124c9a205f"}
Oct 31 12:59:45.576012 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.575982    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pn27v" event={"ID":"f3a39a10-f9df-4e3e-a387-3d9cc1a58334","Type":"ContainerStarted","Data":"651aadce08ccffd3524437a38ef23ae3cb04bd387044101a64b9d24424988761"}
Oct 31 12:59:45.656112 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.656079    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-qdk4f_9cdb8256-bf4d-4bfe-aed0-97643a0151bb/migrator/0.log"
Oct 31 12:59:45.764658 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.764625    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:45.856425 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.856399    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2_9f52f053-a1fd-4300-ae84-ed2d1f280da2/kube-storage-version-migrator-operator/0.log"
Oct 31 12:59:45.962105 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:45.962072    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:46.580456 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:46.580418    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq" event={"ID":"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e","Type":"ContainerStarted","Data":"56ba7871f9d48a4e3d5e9cdce9dd636f38eaab96f50d142d614e9d7888bff0e2"}
Oct 31 12:59:46.580931 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:46.580472    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-4xpsq" event={"ID":"f6bbf522-c1bb-4ab0-8c2e-0f97d2de678e","Type":"ContainerStarted","Data":"1f4bde5296c1775707480cbc90fe049399bf9f4f9a27ccfce7927edd317fc369"}
Oct 31 12:59:46.998778 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:46.998741    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:46.999179 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:46.999160    4958 scope.go:122] "RemoveContainer" containerID="fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0"
Oct 31 12:59:46.999393 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:46.999370    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvcw2_openshift-console-operator(1a9b93d3-7770-4815-9ede-5488c17e029f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f"
Oct 31 12:59:47.150657 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.150600    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:47.150657 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.150659    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:47.150877 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.150747    4958 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:47.150877 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.150819    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls podName:1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:55.150798226 +0000 UTC m=+16.814223904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xjhnz" (UID: "1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7") : secret "cluster-monitoring-operator-tls" not found
Oct 31 12:59:47.151350 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.151325    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83af181e-1103-408a-8ac2-b824f97cb619-service-ca-bundle\") pod \"router-default-64f9757499-rkffd\" (UID: \"83af181e-1103-408a-8ac2-b824f97cb619\") " pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:47.232799 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.232775    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:47.248532 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.248506    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:47.251658 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.251635    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:47.251729 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.251679    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:47.251780 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.251728    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:47.251833 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251814    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:47.251833 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251828    4958 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 12:59:47.251915 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.251872    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:47.251915 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251884    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls podName:3927981d-3a6e-44a0-a152-81798795fa9f nodeName:}" failed. No retries permitted until 2026-10-31 12:59:55.251867606 +0000 UTC m=+16.915293270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls") pod "dns-default-8qxn7" (UID: "3927981d-3a6e-44a0-a152-81798795fa9f") : secret "dns-default-metrics-tls" not found
Oct 31 12:59:47.251915 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251833    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8499fcd869-p8zlf: secret "image-registry-tls" not found
Oct 31 12:59:47.252065 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251942    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls podName:e2a7bad7-2550-4fcb-a12b-d3a0809790a9 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:55.251925973 +0000 UTC m=+16.915351654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls") pod "image-registry-8499fcd869-p8zlf" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9") : secret "image-registry-tls" not found
Oct 31 12:59:47.252065 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251945    4958 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 12:59:47.252065 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251956    4958 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bfbbb8f8d-6rp4v: secret "image-registry-tls" not found
Oct 31 12:59:47.252065 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:47.251996    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls podName:33c9fd30-9e88-4bf7-bbf6-6725274a4371 nodeName:}" failed. No retries permitted until 2026-10-31 12:59:55.251985245 +0000 UTC m=+16.915410924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls") pod "image-registry-bfbbb8f8d-6rp4v" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371") : secret "image-registry-tls" not found
Oct 31 12:59:47.253791 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.253772    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6129e35b-f819-4c82-9fdf-f51ec2d69bf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mq875\" (UID: \"6129e35b-f819-4c82-9fdf-f51ec2d69bf0\") " pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:47.264930 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.264884    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mq875"
Oct 31 12:59:47.268163 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.268134    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:47.423066 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.423029    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:47.528365 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.528339    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f9757499-rkffd"]
Oct 31 12:59:47.530581 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:47.530547    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83af181e_1103_408a_8ac2_b824f97cb619.slice/crio-0db033c6cd0050bd982b5a218b2ab7408e705c34dfb89c3640b4124e3ff52954 WatchSource:0}: Error finding container 0db033c6cd0050bd982b5a218b2ab7408e705c34dfb89c3640b4124e3ff52954: Status 404 returned error can't find the container with id 0db033c6cd0050bd982b5a218b2ab7408e705c34dfb89c3640b4124e3ff52954
Oct 31 12:59:47.547210 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.547185    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mq875"]
Oct 31 12:59:47.557675 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:47.557649    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6129e35b_f819_4c82_9fdf_f51ec2d69bf0.slice/crio-49a85388a69bce4663eb3a29e146f69659a2323e5b15ae10d7336f4bfd453fc6 WatchSource:0}: Error finding container 49a85388a69bce4663eb3a29e146f69659a2323e5b15ae10d7336f4bfd453fc6: Status 404 returned error can't find the container with id 49a85388a69bce4663eb3a29e146f69659a2323e5b15ae10d7336f4bfd453fc6
Oct 31 12:59:47.572152 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.572128    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:47.584680 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.584655    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mq875" event={"ID":"6129e35b-f819-4c82-9fdf-f51ec2d69bf0","Type":"ContainerStarted","Data":"49a85388a69bce4663eb3a29e146f69659a2323e5b15ae10d7336f4bfd453fc6"}
Oct 31 12:59:47.586277 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.586247    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f9757499-rkffd" event={"ID":"83af181e-1103-408a-8ac2-b824f97cb619","Type":"ContainerStarted","Data":"2e619bf9dcf67b096c98d9570f2c548d15b766419a2603e56f270781541da6e4"}
Oct 31 12:59:47.586356 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.586286    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f9757499-rkffd" event={"ID":"83af181e-1103-408a-8ac2-b824f97cb619","Type":"ContainerStarted","Data":"0db033c6cd0050bd982b5a218b2ab7408e705c34dfb89c3640b4124e3ff52954"}
Oct 31 12:59:47.749033 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.749000    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:47.749241 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.749225    4958 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:47.762768 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.762740    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:47.963460 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.963430    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 12:59:47.966258 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:47.966226    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:48.158326 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:48.158292    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:48.248740 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:48.248656    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:48.251787 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:48.251757    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:48.590493 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:48.590413    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mq875" event={"ID":"6129e35b-f819-4c82-9fdf-f51ec2d69bf0","Type":"ContainerStarted","Data":"f6cb7a7887adaae13a3556a107a9eba437aee7303027b2c21d77aac310e185ec"}
Oct 31 12:59:48.590493 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:48.590476    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mq875" event={"ID":"6129e35b-f819-4c82-9fdf-f51ec2d69bf0","Type":"ContainerStarted","Data":"b13910aa44086d99edddc7d643beb05fc240e5e86dd1b7f12483c5c1518b322d"}
Oct 31 12:59:49.163458 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.163424    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:49.366809 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.366780    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:49.572967 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.572928    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:49.594013 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.593976    4958 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:49.781120 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.781084    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:49.975552 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:49.975519    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:50.599491 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:50.599455    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mq875" event={"ID":"6129e35b-f819-4c82-9fdf-f51ec2d69bf0","Type":"ContainerStarted","Data":"80e9c6d9a5ddba67e364c29e9d7aeeb269ea8d6042fc480ccad8a712fba3dbbc"}
Oct 31 12:59:50.864479 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:50.864404    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:51.161660 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.161559    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:51.363096 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.363058    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:51.484567 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.484534    4958 scope.go:122] "RemoveContainer" containerID="fb4e5ca23ce1d3ae42f29c5efe058cdbfd48bc9f3b4e597f64760aa64bf0caf0"
Oct 31 12:59:51.563395 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.563369    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:51.605144 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.605116    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 12:59:51.605510 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.605232    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" event={"ID":"1a9b93d3-7770-4815-9ede-5488c17e029f","Type":"ContainerStarted","Data":"c1df9f96844f5f404eea500d5d256acefd42beb40de32d2ef75ba170c97ff97c"}
Oct 31 12:59:51.605690 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.605671    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:51.606405 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.606382    4958 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-jvcw2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Oct 31 12:59:51.606511 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.606431    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2" podUID="1a9b93d3-7770-4815-9ede-5488c17e029f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused"
Oct 31 12:59:51.719863 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.719830    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:51.720015 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.719936    4958 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 12:59:51.721280 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.721256    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64f9757499-rkffd"
Oct 31 12:59:51.754518 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.754451    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8b4lq"
Oct 31 12:59:51.777615 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:51.777579    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.045225 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.045142    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.201478 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.201447    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.341287 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.341213    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.473997 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.473966    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.612914 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.612835    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvcw2"
Oct 31 12:59:52.636543 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.636510    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:52.765515 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:52.765462    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:53.689327 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:53.689294    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:53.814025 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:53.813996    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:54.022190 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:54.022164    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7p44t"
Oct 31 12:59:55.222413 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.222372    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:55.224933 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.224906    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xjhnz\" (UID: \"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:55.323793 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.323749    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:55.323960 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.323811    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:55.323960 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.323860    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:55.326295 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.326260    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3927981d-3a6e-44a0-a152-81798795fa9f-metrics-tls\") pod \"dns-default-8qxn7\" (UID: \"3927981d-3a6e-44a0-a152-81798795fa9f\") " pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:55.326420 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.326351    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"image-registry-8499fcd869-p8zlf\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") " pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:55.326492 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.326419    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"image-registry-bfbbb8f8d-6rp4v\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") " pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:55.350252 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.350224    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"
Oct 31 12:59:55.352390 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.352371    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:55.363308 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.363285    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:55.364464 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.364437    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:55.647851 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.647777    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz"]
Oct 31 12:59:55.651899 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:55.651864    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce5470a_d4b3_4c5a_a8cd_6e928b02f0c7.slice/crio-0a8becbfdfd22f8475190cf504d8acdb0bf5ef323125e97989fe414565b0914f WatchSource:0}: Error finding container 0a8becbfdfd22f8475190cf504d8acdb0bf5ef323125e97989fe414565b0914f: Status 404 returned error can't find the container with id 0a8becbfdfd22f8475190cf504d8acdb0bf5ef323125e97989fe414565b0914f
Oct 31 12:59:55.655925 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.654806    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 12:59:55.657803 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:55.657780    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a7bad7_2550_4fcb_a12b_d3a0809790a9.slice/crio-e97b5ce37a11f8e2ef6d7ecc63ef1b27eaa8d00808451e5d567177286815ad62 WatchSource:0}: Error finding container e97b5ce37a11f8e2ef6d7ecc63ef1b27eaa8d00808451e5d567177286815ad62: Status 404 returned error can't find the container with id e97b5ce37a11f8e2ef6d7ecc63ef1b27eaa8d00808451e5d567177286815ad62
Oct 31 12:59:55.670810 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.670786    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 12:59:55.673371 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:55.673336    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c9fd30_9e88_4bf7_bbf6_6725274a4371.slice/crio-01a5593a16296825d83f990d591110a3316a32233dfe02c25efcd0004390bb55 WatchSource:0}: Error finding container 01a5593a16296825d83f990d591110a3316a32233dfe02c25efcd0004390bb55: Status 404 returned error can't find the container with id 01a5593a16296825d83f990d591110a3316a32233dfe02c25efcd0004390bb55
Oct 31 12:59:55.676263 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:55.676238    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8qxn7"]
Oct 31 12:59:55.686160 ip-10-0-134-236 kubenswrapper[4958]: W1031 12:59:55.686072    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3927981d_3a6e_44a0_a152_81798795fa9f.slice/crio-f4b6e4bcead7c942512a7ae694e8acff88abc9b99e044cd9b585e1f801e7d695 WatchSource:0}: Error finding container f4b6e4bcead7c942512a7ae694e8acff88abc9b99e044cd9b585e1f801e7d695: Status 404 returned error can't find the container with id f4b6e4bcead7c942512a7ae694e8acff88abc9b99e044cd9b585e1f801e7d695
Oct 31 12:59:56.626954 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.626910    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf" event={"ID":"e2a7bad7-2550-4fcb-a12b-d3a0809790a9","Type":"ContainerStarted","Data":"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"}
Oct 31 12:59:56.627454 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.626977    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf" event={"ID":"e2a7bad7-2550-4fcb-a12b-d3a0809790a9","Type":"ContainerStarted","Data":"e97b5ce37a11f8e2ef6d7ecc63ef1b27eaa8d00808451e5d567177286815ad62"}
Oct 31 12:59:56.627454 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.627202    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 12:59:56.628982 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.628957    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz" event={"ID":"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7","Type":"ContainerStarted","Data":"0a8becbfdfd22f8475190cf504d8acdb0bf5ef323125e97989fe414565b0914f"}
Oct 31 12:59:56.631338 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.630819    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v" event={"ID":"33c9fd30-9e88-4bf7-bbf6-6725274a4371","Type":"ContainerStarted","Data":"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"}
Oct 31 12:59:56.631338 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.630867    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v" event={"ID":"33c9fd30-9e88-4bf7-bbf6-6725274a4371","Type":"ContainerStarted","Data":"01a5593a16296825d83f990d591110a3316a32233dfe02c25efcd0004390bb55"}
Oct 31 12:59:56.631338 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.630926    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 12:59:56.633532 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:56.632943    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qxn7" event={"ID":"3927981d-3a6e-44a0-a152-81798795fa9f","Type":"ContainerStarted","Data":"f4b6e4bcead7c942512a7ae694e8acff88abc9b99e044cd9b585e1f801e7d695"}
Oct 31 12:59:57.569087 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.569054    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 12:59:57.643466 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.643372    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qxn7" event={"ID":"3927981d-3a6e-44a0-a152-81798795fa9f","Type":"ContainerStarted","Data":"72d6109017492b2f18638131d5e311dc42549c81dd27a899b9212029d21f0ed1"}
Oct 31 12:59:57.643973 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.643559    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8qxn7"
Oct 31 12:59:57.643973 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.643601    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qxn7" event={"ID":"3927981d-3a6e-44a0-a152-81798795fa9f","Type":"ContainerStarted","Data":"8fc8f099ce78654e984ec534b406bbd2103090bff0e9b630fe7905c1d180657f"}
Oct 31 12:59:57.696772 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.696741    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:57.891293 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:57.891254    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:58.159271 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:58.159234    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:58.290127 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:58.290089    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:58.424616 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:58.424493    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:58.570406 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:58.570158    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 12:59:58.648399 ip-10-0-134-236 kubenswrapper[4958]: I1031 12:59:58.648358    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xjhnz" event={"ID":"1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7","Type":"ContainerStarted","Data":"9f18562e42f90e6ff8d0f21e3ed63311075071126aa45887f5a5b0b4a9e67c14"}
Oct 31 12:59:59.575009 ip-10-0-134-236 kubenswrapper[4958]: E1031 12:59:59.574972    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:00:01.505844 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:01.505808    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:01.642891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:01.642854    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:01.787383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:01.787285    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:02.199907 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:02.199805    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:02.334658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:02.334629    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:03.887128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:03.887097    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:06.639938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.639907    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:06.833688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.833650    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:06.893737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.893650    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnfmf"]
Oct 31 13:00:06.920282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.920253    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933493 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933462    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933519    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-wtmp\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933645    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-textfile\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933676    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-sys\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933696    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933763    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-root\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933825    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-metrics-client-ca\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933845    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-tls\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.933953 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.933866    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj688\" (UniqueName: \"kubernetes.io/projected/a427bafc-a239-4669-ac39-4753124da7b4-kube-api-access-dj688\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:06.937941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.937915    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8r9q\""
Oct 31 13:00:06.938072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.937975    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 13:00:06.938072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.938002    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 13:00:06.984509 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:06.984476    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:07.005252 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.005231    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 13:00:07.005355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.005253    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 13:00:07.034749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034717    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-wtmp\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.034901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034755    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-textfile\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.034901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034780    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-sys\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.034901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034837    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-sys\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.034901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034877    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.034901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034889    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-wtmp\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034901    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-root\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.034930    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a427bafc-a239-4669-ac39-4753124da7b4-root\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035058    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-metrics-client-ca\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035080    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-textfile\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035095    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-tls\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035125    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj688\" (UniqueName: \"kubernetes.io/projected/a427bafc-a239-4669-ac39-4753124da7b4-kube-api-access-dj688\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035158    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035592 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035569    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.035672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.035571    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a427bafc-a239-4669-ac39-4753124da7b4-metrics-client-ca\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.037538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.037516    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.038365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.038344    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a427bafc-a239-4669-ac39-4753124da7b4-node-exporter-tls\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.048487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.048462    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj688\" (UniqueName: \"kubernetes.io/projected/a427bafc-a239-4669-ac39-4753124da7b4-kube-api-access-dj688\") pod \"node-exporter-fnfmf\" (UID: \"a427bafc-a239-4669-ac39-4753124da7b4\") " pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.122133 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.122097    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:07.268464 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.268426    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:07.272351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.272330    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnfmf"
Oct 31 13:00:07.302192 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:00:07.302163    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda427bafc_a239_4669_ac39_4753124da7b4.slice/crio-78dd696c7e27f85428db95fce9453f5038e0900249d0864c2ddd3fae27a91470 WatchSource:0}: Error finding container 78dd696c7e27f85428db95fce9453f5038e0900249d0864c2ddd3fae27a91470: Status 404 returned error can't find the container with id 78dd696c7e27f85428db95fce9453f5038e0900249d0864c2ddd3fae27a91470
Oct 31 13:00:07.402240 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.402204    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:07.651108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.651027    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8qxn7"
Oct 31 13:00:07.684094 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.684053    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnfmf" event={"ID":"a427bafc-a239-4669-ac39-4753124da7b4","Type":"ContainerStarted","Data":"78dd696c7e27f85428db95fce9453f5038e0900249d0864c2ddd3fae27a91470"}
Oct 31 13:00:07.872952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.872913    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:07.966979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:07.966946    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m7269"
Oct 31 13:00:08.074807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:08.074763    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:08.224848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:08.224759    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:09.250525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:09.250489    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:09.379166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:09.379134    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:09.694271 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:09.694175    4958 generic.go:356] "Generic (PLEG): container finished" podID="a427bafc-a239-4669-ac39-4753124da7b4" containerID="43c71aad77aac7182b5eaf08e2e633f36ac52ba2046021690a1e256487230567" exitCode=0
Oct 31 13:00:09.694410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:09.694274    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnfmf" event={"ID":"a427bafc-a239-4669-ac39-4753124da7b4","Type":"ContainerDied","Data":"43c71aad77aac7182b5eaf08e2e633f36ac52ba2046021690a1e256487230567"}
Oct 31 13:00:09.872214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:09.872181    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:10.008113 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:10.008068    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:10.195181 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:10.195149    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:10.701006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:10.700967    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnfmf" event={"ID":"a427bafc-a239-4669-ac39-4753124da7b4","Type":"ContainerStarted","Data":"b0e6d4239eb1b6c5bb4acf0fb95ba1d0ee762371881853943d4c47a9d2d0ddb5"}
Oct 31 13:00:10.701532 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:10.701042    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnfmf" event={"ID":"a427bafc-a239-4669-ac39-4753124da7b4","Type":"ContainerStarted","Data":"993ab54d4869f0e5ce364d516cdac8bc08213f454471bb921132cadbfa3c6670"}
Oct 31 13:00:10.735865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:10.735813    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnfmf" podStartSLOduration=3.135003034 podStartE2EDuration="4.735798723s" totalImagesPullingTime="1.517803904s" totalInitContainerRuntime="82.991785ms" isStatefulPod=true podCreationTimestamp="2026-10-31 13:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:00:10.735703471 +0000 UTC m=+32.399129156" watchObservedRunningTime="2026-10-31 13:00:10.735798723 +0000 UTC m=+32.399224444"
Oct 31 13:00:11.675886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:11.675841    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:11.815690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:11.815655    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:12.279904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:12.279867    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:12.428267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:12.428233    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:12.982290 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:12.982256    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:13.160737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:13.160703    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:13.379348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:13.379256    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:16.525752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:16.525719    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:16.658139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:16.658107    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:17.190229 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:17.190197    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:17.335694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:17.335661    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:17.648434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:17.648404    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 13:00:17.879986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:17.879955    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:18.014205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:18.014165    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:18.277121 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:18.277015    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:18.406949 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:18.406906    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:18.536043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:18.535965    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:18.655429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:18.655401    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 13:00:19.463504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:19.463464    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 13:00:19.619655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:19.619591    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:19.751066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:19.750982    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:21.230374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:21.230342    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:21.366481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:21.366448    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:22.614365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:22.614331    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:22.751291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:22.751259    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:23.673731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.673686    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf" podUID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" containerName="registry" containerID="cri-o://ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6" gracePeriod=30
Oct 31 13:00:23.938482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.938408    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 13:00:23.973069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973030    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973098    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973131    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973166    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973190    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973220    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973254    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973297    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") pod \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\" (UID: \"e2a7bad7-2550-4fcb-a12b-d3a0809790a9\") "
Oct 31 13:00:23.973667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973640    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:00:23.973942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.973907    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:00:23.976297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.976267    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "kube-api-access-8mtr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:23.976429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.976382    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:00:23.976502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.976472    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:23.976548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.976532    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:00:23.977699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.977677    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:23.982061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:23.982025    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted" pod "e2a7bad7-2550-4fcb-a12b-d3a0809790a9" (UID: "e2a7bad7-2550-4fcb-a12b-d3a0809790a9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:00:24.074260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074220    4958 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-certificates\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074253    4958 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-bound-sa-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074264    4958 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-trusted-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074273    4958 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-ca-trust-extracted\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074282    4958 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-registry-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074291    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mtr9\" (UniqueName: \"kubernetes.io/projected/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-kube-api-access-8mtr9\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074301    4958 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-image-registry-private-configuration\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.074540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.074311    4958 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2a7bad7-2550-4fcb-a12b-d3a0809790a9-installation-pull-secrets\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:24.757231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.757146    4958 generic.go:356] "Generic (PLEG): container finished" podID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" containerID="ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6" exitCode=0
Oct 31 13:00:24.757231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.757193    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf"
Oct 31 13:00:24.757231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.757218    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf" event={"ID":"e2a7bad7-2550-4fcb-a12b-d3a0809790a9","Type":"ContainerDied","Data":"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"}
Oct 31 13:00:24.757828 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.757262    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8499fcd869-p8zlf" event={"ID":"e2a7bad7-2550-4fcb-a12b-d3a0809790a9","Type":"ContainerDied","Data":"e97b5ce37a11f8e2ef6d7ecc63ef1b27eaa8d00808451e5d567177286815ad62"}
Oct 31 13:00:24.757828 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.757281    4958 scope.go:122] "RemoveContainer" containerID="ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"
Oct 31 13:00:24.765792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.765770    4958 scope.go:122] "RemoveContainer" containerID="ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"
Oct 31 13:00:24.766122 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:00:24.766094    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6\": container with ID starting with ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6 not found: ID does not exist" containerID="ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"
Oct 31 13:00:24.766204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.766131    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6"} err="failed to get container status \"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6\": rpc error: code = NotFound desc = could not find container \"ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6\": container with ID starting with ad9cfa070c1245ee82f5e136d638c2287de22c6d445a33c50538d1bbd9cf39c6 not found: ID does not exist"
Oct 31 13:00:24.781029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.780953    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 13:00:24.786525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:24.786501    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8499fcd869-p8zlf"]
Oct 31 13:00:26.488515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:26.488481    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" path="/var/lib/kubelet/pods/e2a7bad7-2550-4fcb-a12b-d3a0809790a9/volumes"
Oct 31 13:00:26.911263 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:26.911186    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:27.061135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:27.061102    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:28.336870 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:28.336833    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:28.493128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:28.493095    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:29.573514 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:00:29.573472    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:00:32.187250 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:32.187216    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:32.322918 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:32.322889    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:34.883155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:34.883112    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:35.016096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:35.016060    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:43.831759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:43.831723    4958 generic.go:356] "Generic (PLEG): container finished" podID="9f52f053-a1fd-4300-ae84-ed2d1f280da2" containerID="e16fe1f4066a0f7aa28f9d84ff10a33835f158a1a5d9b813be1e6be479b30d5b" exitCode=0
Oct 31 13:00:43.832154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:43.831798    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2" event={"ID":"9f52f053-a1fd-4300-ae84-ed2d1f280da2","Type":"ContainerDied","Data":"e16fe1f4066a0f7aa28f9d84ff10a33835f158a1a5d9b813be1e6be479b30d5b"}
Oct 31 13:00:43.832154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:43.832124    4958 scope.go:122] "RemoveContainer" containerID="e16fe1f4066a0f7aa28f9d84ff10a33835f158a1a5d9b813be1e6be479b30d5b"
Oct 31 13:00:44.484261 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.484218    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v" podUID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" containerName="registry" containerID="cri-o://28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744" gracePeriod=30
Oct 31 13:00:44.521939 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:00:44.521902    4958 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c9fd30_9e88_4bf7_bbf6_6725274a4371.slice/crio-conmon-28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 13:00:44.727088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.727060    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 13:00:44.837715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.837624    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-5j9f2" event={"ID":"9f52f053-a1fd-4300-ae84-ed2d1f280da2","Type":"ContainerStarted","Data":"4d85d79aaf3a156f82fa054196bc6e130efcf58e16077c1b9fbe14a08622c3f6"}
Oct 31 13:00:44.838939 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.838913    4958 generic.go:356] "Generic (PLEG): container finished" podID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" containerID="28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744" exitCode=0
Oct 31 13:00:44.839054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.838948    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v" event={"ID":"33c9fd30-9e88-4bf7-bbf6-6725274a4371","Type":"ContainerDied","Data":"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"}
Oct 31 13:00:44.839054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.838950    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"
Oct 31 13:00:44.839054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.838991    4958 scope.go:122] "RemoveContainer" containerID="28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"
Oct 31 13:00:44.839167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.838981    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bfbbb8f8d-6rp4v" event={"ID":"33c9fd30-9e88-4bf7-bbf6-6725274a4371","Type":"ContainerDied","Data":"01a5593a16296825d83f990d591110a3316a32233dfe02c25efcd0004390bb55"}
Oct 31 13:00:44.844952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.844929    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.844968    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.844991    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845035    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845056    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845080    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845321 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845268    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845326    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") pod \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\" (UID: \"33c9fd30-9e88-4bf7-bbf6-6725274a4371\") "
Oct 31 13:00:44.845433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845412    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:00:44.845553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845529    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:00:44.845699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.845558    4958 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-certificates\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.847734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.847704    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:00:44.848383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.848360    4958 scope.go:122] "RemoveContainer" containerID="28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"
Oct 31 13:00:44.848740 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:00:44.848713    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744\": container with ID starting with 28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744 not found: ID does not exist" containerID="28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"
Oct 31 13:00:44.848842 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.848750    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744"} err="failed to get container status \"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744\": rpc error: code = NotFound desc = could not find container \"28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744\": container with ID starting with 28d04ddf85abe1c4afe22fce9425346a0da590e53ec5a6c00058619032228744 not found: ID does not exist"
Oct 31 13:00:44.848933 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.848909    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:44.849042 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.849022    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:00:44.849118 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.849034    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "kube-api-access-lf52c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:44.850148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.850127    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:00:44.852824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.852800    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted" pod "33c9fd30-9e88-4bf7-bbf6-6725274a4371" (UID: "33c9fd30-9e88-4bf7-bbf6-6725274a4371"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:00:44.946733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946689    4958 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-registry-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946727    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf52c\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-kube-api-access-lf52c\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946738    4958 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33c9fd30-9e88-4bf7-bbf6-6725274a4371-trusted-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946753    4958 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-image-registry-private-configuration\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946764    4958 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33c9fd30-9e88-4bf7-bbf6-6725274a4371-bound-sa-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946773    4958 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33c9fd30-9e88-4bf7-bbf6-6725274a4371-ca-trust-extracted\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:44.946969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:44.946860    4958 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33c9fd30-9e88-4bf7-bbf6-6725274a4371-installation-pull-secrets\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:00:45.162129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:45.162087    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 13:00:45.166768 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:45.166735    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bfbbb8f8d-6rp4v"]
Oct 31 13:00:46.376392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:46.376348    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:46.492767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:46.492731    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" path="/var/lib/kubelet/pods/33c9fd30-9e88-4bf7-bbf6-6725274a4371/volumes"
Oct 31 13:00:46.527267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:46.527234    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:46.664582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:46.664503    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:47.188349 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:47.188313    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:47.322064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:47.322027    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:48.856853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:48.856818    4958 generic.go:356] "Generic (PLEG): container finished" podID="cc2822c2-f4d2-4b60-be36-8377ff659009" containerID="098563936aa395f403a3e4e4cc55beeaa73e7e1595e61205c44b989515237137" exitCode=0
Oct 31 13:00:48.857494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:48.857467    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ffdc6" event={"ID":"cc2822c2-f4d2-4b60-be36-8377ff659009","Type":"ContainerDied","Data":"098563936aa395f403a3e4e4cc55beeaa73e7e1595e61205c44b989515237137"}
Oct 31 13:00:48.858142 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:48.858109    4958 scope.go:122] "RemoveContainer" containerID="098563936aa395f403a3e4e4cc55beeaa73e7e1595e61205c44b989515237137"
Oct 31 13:00:49.309762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.309727    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-7m5fv-b2fjn"]
Oct 31 13:00:49.310043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310019    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" containerName="registry"
Oct 31 13:00:49.310043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310033    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" containerName="registry"
Oct 31 13:00:49.310131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310062    4958 cpu_manager.go:414] "containerMap: removing container" podUID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" containerName="registry"
Oct 31 13:00:49.310131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310068    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" containerName="registry"
Oct 31 13:00:49.310131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310115    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="33c9fd30-9e88-4bf7-bbf6-6725274a4371" containerName="registry"
Oct 31 13:00:49.310131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.310124    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2a7bad7-2550-4fcb-a12b-d3a0809790a9" containerName="registry"
Oct 31 13:00:49.312929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.312911    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.317360 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.317334    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lt77s\""
Oct 31 13:00:49.322241 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.322205    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7m5fv-b2fjn"]
Oct 31 13:00:49.385431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.385395    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrh6\" (UniqueName: \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.385590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.385437    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.385590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.385460    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.385708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.385621    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.486789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.486753    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrh6\" (UniqueName: \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.486789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.486796    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.486992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.486813    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.486992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.486857    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.487136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.487117    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.487664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.487643    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.487722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.487705    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.500047 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.500015    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrh6\" (UniqueName: \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\") pod \"periodic-gathering-7m5fv-b2fjn\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") " pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.625443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.625345    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:00:49.863646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.863589    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ffdc6" event={"ID":"cc2822c2-f4d2-4b60-be36-8377ff659009","Type":"ContainerStarted","Data":"4164215661fd0fb4708921b8991ad78e5a29c9f733ae8d933673e815397da613"}
Oct 31 13:00:49.898111 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:49.898030    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-7m5fv-b2fjn"]
Oct 31 13:00:49.901721 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:00:49.901686    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87300d62_5674_4798_8525_a902249459c5.slice/crio-9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7 WatchSource:0}: Error finding container 9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7: Status 404 returned error can't find the container with id 9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7
Oct 31 13:00:50.868667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:50.868633    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn" event={"ID":"87300d62-5674-4798-8525-a902249459c5","Type":"ContainerStarted","Data":"198cd4987c364384ad0c7c412fa314d6d934609e860928c530af24b0696602a5"}
Oct 31 13:00:50.869112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:50.868682    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn" event={"ID":"87300d62-5674-4798-8525-a902249459c5","Type":"ContainerStarted","Data":"9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7"}
Oct 31 13:00:50.888543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:50.888496    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn" podStartSLOduration=1.888481933 podStartE2EDuration="1.888481933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:00:50.88768768 +0000 UTC m=+72.551113365" watchObservedRunningTime="2026-10-31 13:00:50.888481933 +0000 UTC m=+72.551907614"
Oct 31 13:00:55.180188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:55.180144    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:55.316198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:55.316168    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:55.723116 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:55.723082    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:55.924224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:55.924186    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:00:59.572518 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:00:59.572482    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:00:59.992442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:00:59.992408    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:01:00.908805 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:00.908769    4958 generic.go:356] "Generic (PLEG): container finished" podID="c59aae6f-85e0-4524-8e3d-3b559ad1fdb2" containerID="f8d2ce96cfaccdec2f651c3005a7f3db5df40bf15ffc7250465d44e0c6173c8d" exitCode=0
Oct 31 13:01:00.909228 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:00.908843    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m" event={"ID":"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2","Type":"ContainerDied","Data":"f8d2ce96cfaccdec2f651c3005a7f3db5df40bf15ffc7250465d44e0c6173c8d"}
Oct 31 13:01:00.909228 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:00.909205    4958 scope.go:122] "RemoveContainer" containerID="f8d2ce96cfaccdec2f651c3005a7f3db5df40bf15ffc7250465d44e0c6173c8d"
Oct 31 13:01:01.915220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:01.915178    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-z9v9m" event={"ID":"c59aae6f-85e0-4524-8e3d-3b559ad1fdb2","Type":"ContainerStarted","Data":"f60c710e24a24ad80ed8e0a0c277790e9bcbbef725a7314309fdb841f31bd052"}
Oct 31 13:01:28.409289 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:28.409245    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:01:29.576026 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:01:29.575983    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:01:56.609230 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:01:56.609132    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:01:59.573309 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:01:59.573268    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:02:01.606744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:01.606692    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:01.740214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:01.740180    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:02.886749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:02.886707    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:03.016122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:03.016086    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:03.506402 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:03.506366    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:09.191729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:09.191675    4958 generic.go:356] "Generic (PLEG): container finished" podID="87300d62-5674-4798-8525-a902249459c5" containerID="198cd4987c364384ad0c7c412fa314d6d934609e860928c530af24b0696602a5" exitCode=0
Oct 31 13:02:09.192158 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:09.191753    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn" event={"ID":"87300d62-5674-4798-8525-a902249459c5","Type":"ContainerDied","Data":"198cd4987c364384ad0c7c412fa314d6d934609e860928c530af24b0696602a5"}
Oct 31 13:02:10.328857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.328830    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:02:10.336437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336414    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\") pod \"87300d62-5674-4798-8525-a902249459c5\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") "
Oct 31 13:02:10.336547 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336468    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\") pod \"87300d62-5674-4798-8525-a902249459c5\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") "
Oct 31 13:02:10.336547 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336501    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\" (UniqueName: \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\") pod \"87300d62-5674-4798-8525-a902249459c5\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") "
Oct 31 13:02:10.336547 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336530    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\") pod \"87300d62-5674-4798-8525-a902249459c5\" (UID: \"87300d62-5674-4798-8525-a902249459c5\") "
Oct 31 13:02:10.336860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336826    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path" pod "87300d62-5674-4798-8525-a902249459c5" (UID: "87300d62-5674-4798-8525-a902249459c5"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:02:10.336975 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336874    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle" pod "87300d62-5674-4798-8525-a902249459c5" (UID: "87300d62-5674-4798-8525-a902249459c5"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:02:10.336975 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.336914    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle" pod "87300d62-5674-4798-8525-a902249459c5" (UID: "87300d62-5674-4798-8525-a902249459c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:02:10.338779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.338756    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6" pod "87300d62-5674-4798-8525-a902249459c5" (UID: "87300d62-5674-4798-8525-a902249459c5"). InnerVolumeSpecName "kube-api-access-4lrh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:02:10.437129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.437092    4958 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-service-ca-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:02:10.437129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.437123    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lrh6\" (UniqueName: \"kubernetes.io/projected/87300d62-5674-4798-8525-a902249459c5-kube-api-access-4lrh6\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:02:10.437129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.437133    4958 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87300d62-5674-4798-8525-a902249459c5-trusted-ca-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:02:10.437129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:10.437143    4958 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/87300d62-5674-4798-8525-a902249459c5-archives-path\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:02:11.201135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:11.201094    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn" event={"ID":"87300d62-5674-4798-8525-a902249459c5","Type":"ContainerDied","Data":"9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7"}
Oct 31 13:02:11.201329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:11.201185    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fdef6e292ce6fd0ebbfca22d459df08665ef248946a7ea38433edebd6f758b7"
Oct 31 13:02:11.201329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:11.201112    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-7m5fv-b2fjn"
Oct 31 13:02:11.596891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:11.596855    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:11.731129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:11.731091    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:14.259491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:14.259459    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:14.396844 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:14.396809    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:17.198484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:17.198446    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:17.338177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:17.338141    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:25.056661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:25.056626    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:28.453664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:28.453631    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:29.573466 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:02:29.573426    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:02:49.402106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:02:49.402071    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:02:59.572395 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:02:59.572356    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:03:28.529701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:03:28.529597    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:03:29.571764 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:03:29.571726    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:03:59.571556 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:03:59.571518    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:04:28.565347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:28.565311    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:29.573574 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:04:29.573533    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:04:32.827718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:32.827686    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:32.991830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:32.991798    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:33.129370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.129288    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:33.790152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.790118    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"]
Oct 31 13:04:33.790412 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.790400    4958 cpu_manager.go:414] "containerMap: removing container" podUID="87300d62-5674-4798-8525-a902249459c5" containerName="insights-gathering"
Oct 31 13:04:33.790458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.790413    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87300d62-5674-4798-8525-a902249459c5" containerName="insights-gathering"
Oct 31 13:04:33.790491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.790481    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="87300d62-5674-4798-8525-a902249459c5" containerName="insights-gathering"
Oct 31 13:04:33.793572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.793546    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:33.798320 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.798302    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 13:04:33.799392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.799369    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 13:04:33.799492 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.799470    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-6flxs\""
Oct 31 13:04:33.823952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.823927    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"]
Oct 31 13:04:33.877136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.877105    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"]
Oct 31 13:04:33.880409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.880391    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:33.891373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.891347    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"]
Oct 31 13:04:33.904822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.904797    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-v5w5k\""
Oct 31 13:04:33.930234 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.930195    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkzj\" (UniqueName: \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:33.930414 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.930250    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:33.930414 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:33.930360    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.031265 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031226    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.031265 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031271    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccnf\" (UniqueName: \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.031530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031301    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.031530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031321    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.031530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031466    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.032040 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031529    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkzj\" (UniqueName: \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.032040 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031769    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.032040 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.031794    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.050651 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.050551    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkzj\" (UniqueName: \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.109616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.109576    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:04:34.132562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.132530    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.132729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.132618    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccnf\" (UniqueName: \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.132729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.132663    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.132965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.132941    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.133033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.132968    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.149149 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.148278    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccnf\" (UniqueName: \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.196267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.196233    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:04:34.387164 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.387058    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"]
Oct 31 13:04:34.389888 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:34.389861    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc31819_5834_48cb_8e60_3b395d142ba9.slice/crio-b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459 WatchSource:0}: Error finding container b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459: Status 404 returned error can't find the container with id b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459
Oct 31 13:04:34.475483 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.475448    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"]
Oct 31 13:04:34.478554 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:34.478524    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350bd2fc_7361_4807_96d9_547282b02074.slice/crio-e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945 WatchSource:0}: Error finding container e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945: Status 404 returned error can't find the container with id e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945
Oct 31 13:04:34.536449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.536416    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:34.681860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.681771    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:34.763155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.763116    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerStarted","Data":"b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459"}
Oct 31 13:04:34.764281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:34.764251    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p" event={"ID":"350bd2fc-7361-4807-96d9-547282b02074","Type":"ContainerStarted","Data":"e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945"}
Oct 31 13:04:35.237921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:35.237880    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:35.997041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:35.996975    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:36.849384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.849348    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"]
Oct 31 13:04:36.853476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.853449    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:36.859133 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.859103    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-fktp9\""
Oct 31 13:04:36.867585 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.867507    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"]
Oct 31 13:04:36.956956 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.956907    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hrd\" (UniqueName: \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:36.957153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.957071    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:36.957153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:36.957140    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.057993 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.057953    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.058185 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.058011    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hrd\" (UniqueName: \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.058185 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.058072    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.058568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.058536    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.059005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.058982    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.072709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.072674    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hrd\" (UniqueName: \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.176392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.176305    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:04:37.466598 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.466563    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"]
Oct 31 13:04:37.471214 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:37.471187    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8693c32_8b2e_4c32_b262_e9c31129ac18.slice/crio-1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2 WatchSource:0}: Error finding container 1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2: Status 404 returned error can't find the container with id 1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2
Oct 31 13:04:37.782191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:37.782106    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz" event={"ID":"b8693c32-8b2e-4c32-b262-e9c31129ac18","Type":"ContainerStarted","Data":"1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2"}
Oct 31 13:04:38.126423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.126327    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:38.258650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.258520    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:38.509226 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.508920    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:04:38.513137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.513109    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:04:38.519974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.519940    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:04:38.522654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.522628    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:04:38.746049 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.746012    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"]
Oct 31 13:04:38.750993 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.750954    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.755154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.755116    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-jm6bj\""
Oct 31 13:04:38.762720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.761644    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"]
Oct 31 13:04:38.781860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.781789    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:38.848598 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.848559    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"]
Oct 31 13:04:38.852797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.852764    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:38.868108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.868067    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"]
Oct 31 13:04:38.868920 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.868892    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-q6x8v\""
Oct 31 13:04:38.873225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.873163    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.873370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.873247    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.873370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.873320    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2t5c\" (UniqueName: \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.935055 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.935012    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:38.973695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.973659    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"]
Oct 31 13:04:38.975936 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.975901    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.976086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.975964    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2t5c\" (UniqueName: \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.976086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976004    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:38.976086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976040    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rzr\" (UniqueName: \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:38.976086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976059    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.976086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976081    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:38.976451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976434    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.976978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.976960    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:38.978276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.978258    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:38.982843 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.982817    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-hvzm4\""
Oct 31 13:04:38.990481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.990457    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"]
Oct 31 13:04:38.993410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:38.993325    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2t5c\" (UniqueName: \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:39.065933 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.065850    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"]
Oct 31 13:04:39.069936 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.069909    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.076677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.076649    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.076937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.076915    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq787\" (UniqueName: \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.077160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077137    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rzr\" (UniqueName: \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.077385 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077364    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.077541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077523    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.077724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077707    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.077875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077851    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.078004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.077987    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:04:39.078915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.078890    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.081104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.081080    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"]
Oct 31 13:04:39.086885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.086858    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-tkvxc\""
Oct 31 13:04:39.097597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.097510    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rzr\" (UniqueName: \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.182990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.182952    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq787\" (UniqueName: \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.183480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183028    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.183480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183060    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.183480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183101    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjt2\" (UniqueName: \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.183480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183142    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.183480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183198    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.183972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.183948    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.184204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.184185    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.191135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.190901    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:04:39.197283 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.197241    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq787\" (UniqueName: \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.283733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.283686    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.283902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.283779    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.283902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.283830    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjt2\" (UniqueName: \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.284891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.284864    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.285163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.285145    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.299345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.299302    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjt2\" (UniqueName: \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.300983 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.300745    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:04:39.382334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.382100    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"]
Oct 31 13:04:39.397110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.397081    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:04:39.480784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.480749    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"]
Oct 31 13:04:39.492134 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:39.492099    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedabf7a4_563c_4b7f_9e49_0ad5fff03cfa.slice/crio-f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81 WatchSource:0}: Error finding container f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81: Status 404 returned error can't find the container with id f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81
Oct 31 13:04:39.589379 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.589294    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"]
Oct 31 13:04:39.593180 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:39.593142    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cdcb2c_75d9_42ad_a61b_ba4bf3670f64.slice/crio-746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a WatchSource:0}: Error finding container 746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a: Status 404 returned error can't find the container with id 746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a
Oct 31 13:04:39.690142 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.690098    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"]
Oct 31 13:04:39.695820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.695495    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.702435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.702393    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 13:04:39.707227 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.707194    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"]
Oct 31 13:04:39.712017 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.711989    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dmjbc\""
Oct 31 13:04:39.720945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.720875    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"]
Oct 31 13:04:39.724979 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:39.724943    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d24ab3e_a385_494e_a7dc_ad499b58f3c5.slice/crio-b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332 WatchSource:0}: Error finding container b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332: Status 404 returned error can't find the container with id b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332
Oct 31 13:04:39.782492 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.780944    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"]
Oct 31 13:04:39.783048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.783019    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:39.787305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.784897    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.790928    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.790964    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.790986    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791006    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791025    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791048    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5mqq\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-kube-api-access-z5mqq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791067    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791089    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.791105    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8004ca3a-1ba4-4031-a3a0-8daf23610852-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.797708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.797680    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"]
Oct 31 13:04:39.799175 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.799041    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll" event={"ID":"7d24ab3e-a385-494e-a7dc-ad499b58f3c5","Type":"ContainerStarted","Data":"b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332"}
Oct 31 13:04:39.800736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.800711    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx" event={"ID":"442b9aa7-87a1-41dc-a140-ce27bcf2ce99","Type":"ContainerStarted","Data":"5c12e1a697b9a5f9183644bed8584b394a4a499bcae7446b2f091f062911191e"}
Oct 31 13:04:39.802390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.802340    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w" event={"ID":"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64","Type":"ContainerStarted","Data":"746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a"}
Oct 31 13:04:39.805425 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.805378    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h" event={"ID":"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa","Type":"ContainerStarted","Data":"f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81"}
Oct 31 13:04:39.821089 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.821055    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-gsrkk\""
Oct 31 13:04:39.892630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892523    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2m8t\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-kube-api-access-j2m8t\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.892630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892571    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.892630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892597    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.892868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892682    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.892868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892768    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.892868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892846    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.892992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892887    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.892992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892915    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.892992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892953    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.892992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.892983    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.893222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893028    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5mqq\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-kube-api-access-z5mqq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893056    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893075    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893099    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9345fc7-e94c-41ca-9c20-040563b0e21e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.893222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893180    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893246    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8004ca3a-1ba4-4031-a3a0-8daf23610852-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893427    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.893955 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.893929    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.894282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.894258    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.894341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.894302    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.894341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.894333    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.894504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.894481    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8004ca3a-1ba4-4031-a3a0-8daf23610852-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.894922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.894881    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.897183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.897159    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.897864 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.897802    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.918188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.918127    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5mqq\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-kube-api-access-z5mqq\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.927517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.927458    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8004ca3a-1ba4-4031-a3a0-8daf23610852-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-58mdk\" (UID: \"8004ca3a-1ba4-4031-a3a0-8daf23610852\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:39.973590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.973502    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995014    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995066    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995119    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9345fc7-e94c-41ca-9c20-040563b0e21e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995172    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995202    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995245    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m8t\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-kube-api-access-j2m8t\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995283    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995319    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.995344    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.996478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.996212    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.998309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.997327    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.998309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.997362    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.998309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.998115    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9345fc7-e94c-41ca-9c20-040563b0e21e-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.998309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.998251    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.999477 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.998934    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:39.999477 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:39.999314    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:40.012729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.012675    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:40.014476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.014445    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:40.031628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.031587    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2m8t\" (UniqueName: \"kubernetes.io/projected/a9345fc7-e94c-41ca-9c20-040563b0e21e-kube-api-access-j2m8t\") pod \"openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt\" (UID: \"a9345fc7-e94c-41ca-9c20-040563b0e21e\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:40.102352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.102317    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:40.261631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.261082    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"]
Oct 31 13:04:40.266198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.266174    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.278579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.278528    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"]
Oct 31 13:04:40.336979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.336897    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"]
Oct 31 13:04:40.339626 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:40.339568    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8004ca3a_1ba4_4031_a3a0_8daf23610852.slice/crio-29050118b2aa79bb7ceb1158193bebc04943b3bb696bcac8200fc00eed74adef WatchSource:0}: Error finding container 29050118b2aa79bb7ceb1158193bebc04943b3bb696bcac8200fc00eed74adef: Status 404 returned error can't find the container with id 29050118b2aa79bb7ceb1158193bebc04943b3bb696bcac8200fc00eed74adef
Oct 31 13:04:40.398643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.398547    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.398837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.398652    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wh4s\" (UniqueName: \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.398837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.398697    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.406947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.406907    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"]
Oct 31 13:04:40.416458 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:40.416393    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9345fc7_e94c_41ca_9c20_040563b0e21e.slice/crio-71cfbf1ecf07bf1b53f7db54346972897186bbf087dc726e61ec48e4976ac021 WatchSource:0}: Error finding container 71cfbf1ecf07bf1b53f7db54346972897186bbf087dc726e61ec48e4976ac021: Status 404 returned error can't find the container with id 71cfbf1ecf07bf1b53f7db54346972897186bbf087dc726e61ec48e4976ac021
Oct 31 13:04:40.500530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.500494    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.500744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.500620    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wh4s\" (UniqueName: \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.500744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.500691    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.501460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.501232    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.502233 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.501600    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.528563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.528529    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wh4s\" (UniqueName: \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.591008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.590726    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:04:40.703363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.703321    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"]
Oct 31 13:04:40.708852 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.708822    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.721388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.721308    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"]
Oct 31 13:04:40.804466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.804370    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.804466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.804417    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.804466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.804464    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsq2\" (UniqueName: \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.818898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.818849    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt" event={"ID":"a9345fc7-e94c-41ca-9c20-040563b0e21e","Type":"ContainerStarted","Data":"71cfbf1ecf07bf1b53f7db54346972897186bbf087dc726e61ec48e4976ac021"}
Oct 31 13:04:40.824424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.824370    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" event={"ID":"8004ca3a-1ba4-4031-a3a0-8daf23610852","Type":"ContainerStarted","Data":"29050118b2aa79bb7ceb1158193bebc04943b3bb696bcac8200fc00eed74adef"}
Oct 31 13:04:40.907438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.907387    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.907632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.907484    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.907632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.907575    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsq2\" (UniqueName: \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.907965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.907936    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.908222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.908200    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:40.910549 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.910523    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"]
Oct 31 13:04:40.918512 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:04:40.918485    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bc722c_d123_4c2b_9b7b_3383a88e75ce.slice/crio-8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53 WatchSource:0}: Error finding container 8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53: Status 404 returned error can't find the container with id 8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53
Oct 31 13:04:40.924625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:40.924553    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsq2\" (UniqueName: \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:41.041271 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:41.040961    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:04:41.394823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:41.394715    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"]
Oct 31 13:04:41.839129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:41.839036    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6" event={"ID":"7fb909de-a162-4cb5-948b-5ed3fc702618","Type":"ContainerStarted","Data":"02df36843b03861956c839103e6930acfc8eb31c197fc8e523dccb976280e876"}
Oct 31 13:04:41.857831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:41.857705    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm" event={"ID":"f6bc722c-d123-4c2b-9b7b-3383a88e75ce","Type":"ContainerStarted","Data":"8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53"}
Oct 31 13:04:42.892225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:42.892185    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:04:45.927449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:45.927142    4958 generic.go:356] "Generic (PLEG): container finished" podID="efc31819-5834-48cb-8e60-3b395d142ba9" containerID="d670fb7b80da4c791c6b9002d0043743dee65630c6b936f73b360f2105d22ae5" exitCode=0
Oct 31 13:04:45.927449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:45.927277    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerDied","Data":"d670fb7b80da4c791c6b9002d0043743dee65630c6b936f73b360f2105d22ae5"}
Oct 31 13:04:45.934426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:45.934394    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:04:46.940103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:46.940060    4958 generic.go:356] "Generic (PLEG): container finished" podID="350bd2fc-7361-4807-96d9-547282b02074" containerID="d7c952e769805750019edb947c5f159473c0b09c139c82b4bff6e7171cc51c0b" exitCode=0
Oct 31 13:04:46.940543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:46.940208    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p" event={"ID":"350bd2fc-7361-4807-96d9-547282b02074","Type":"ContainerDied","Data":"d7c952e769805750019edb947c5f159473c0b09c139c82b4bff6e7171cc51c0b"}
Oct 31 13:04:46.959123 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:46.959084    4958 generic.go:356] "Generic (PLEG): container finished" podID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerID="2f8712fd97c36ead74e120d2c8fa6869d78e925c2c0818784381cc0f6babf585" exitCode=0
Oct 31 13:04:46.959287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:46.959207    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz" event={"ID":"b8693c32-8b2e-4c32-b262-e9c31129ac18","Type":"ContainerDied","Data":"2f8712fd97c36ead74e120d2c8fa6869d78e925c2c0818784381cc0f6babf585"}
Oct 31 13:04:47.978122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:47.977199    4958 generic.go:356] "Generic (PLEG): container finished" podID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerID="474f1bc45e335ca4119caee32c601193ce70218399b5fb2153bf49bf86fa2cdd" exitCode=0
Oct 31 13:04:47.978122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:47.977284    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz" event={"ID":"b8693c32-8b2e-4c32-b262-e9c31129ac18","Type":"ContainerDied","Data":"474f1bc45e335ca4119caee32c601193ce70218399b5fb2153bf49bf86fa2cdd"}
Oct 31 13:04:49.810139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:49.810096    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:49.810570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:49.810207    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:49.810570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:49.810253    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:50.014218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.013234    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt" event={"ID":"a9345fc7-e94c-41ca-9c20-040563b0e21e","Type":"ContainerStarted","Data":"e06f4169c261ca44018f0e463aba5963472427961e401364261b8f8e4efe0708"}
Oct 31 13:04:50.043801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.043120    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt" podStartSLOduration=1.6541551650000001 podStartE2EDuration="11.043097928s" totalImagesPullingTime="9.388942763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:04:50.040619978 +0000 UTC m=+311.704045661" watchObservedRunningTime="2026-10-31 13:04:50.043097928 +0000 UTC m=+311.706523617"
Oct 31 13:04:50.104410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.103078    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:50.105040 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.104702    4958 patch_prober.go:29] interesting pod/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 13:04:50.105040 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.104758    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt" podUID="a9345fc7-e94c-41ca-9c20-040563b0e21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 13:04:50.480401 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.480351    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:50.480559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.480452    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:50.480559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:50.480498    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:04:51.041540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:51.041444    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" event={"ID":"8004ca3a-1ba4-4031-a3a0-8daf23610852","Type":"ContainerStarted","Data":"c319764edd7186ef323d811fb62edcdf1cb35b2d1f11740795f6ca0d0d3e1c0b"}
Oct 31 13:04:51.073253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:51.073183    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podStartSLOduration=1.937073067 podStartE2EDuration="12.073162057s" totalImagesPullingTime="10.13608899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:04:51.069876317 +0000 UTC m=+312.733302003" watchObservedRunningTime="2026-10-31 13:04:51.073162057 +0000 UTC m=+312.736587739"
Oct 31 13:04:51.109356 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:51.109079    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:52.015731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.015697    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:52.022357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.022080    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:52.049852 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.049382    4958 generic.go:356] "Generic (PLEG): container finished" podID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerID="f12d2ea9b93956942da2de25768f4027b3d1295df70aa31cd912b3cf9cf163dd" exitCode=0
Oct 31 13:04:52.049852 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.049488    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h" event={"ID":"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa","Type":"ContainerDied","Data":"f12d2ea9b93956942da2de25768f4027b3d1295df70aa31cd912b3cf9cf163dd"}
Oct 31 13:04:52.055490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.053761    4958 generic.go:356] "Generic (PLEG): container finished" podID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerID="9e26ffed89053f5764ecb7b9dbddabc92d160c75b681dbce16203d927a41d7a2" exitCode=0
Oct 31 13:04:52.055490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.053846    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll" event={"ID":"7d24ab3e-a385-494e-a7dc-ad499b58f3c5","Type":"ContainerDied","Data":"9e26ffed89053f5764ecb7b9dbddabc92d160c75b681dbce16203d927a41d7a2"}
Oct 31 13:04:52.060642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.059988    4958 generic.go:356] "Generic (PLEG): container finished" podID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerID="1443b4ca2b43b2598fb51b0fba5c4803e0524bbc663d923336e94e4bed228316" exitCode=0
Oct 31 13:04:52.060642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.060097    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx" event={"ID":"442b9aa7-87a1-41dc-a140-ce27bcf2ce99","Type":"ContainerDied","Data":"1443b4ca2b43b2598fb51b0fba5c4803e0524bbc663d923336e94e4bed228316"}
Oct 31 13:04:52.068499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.067199    4958 generic.go:356] "Generic (PLEG): container finished" podID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerID="24f42f7cd4ad46bd166536206c5b4958b9522188c5656c7aebfd60698494d035" exitCode=0
Oct 31 13:04:52.070075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.069020    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w" event={"ID":"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64","Type":"ContainerDied","Data":"24f42f7cd4ad46bd166536206c5b4958b9522188c5656c7aebfd60698494d035"}
Oct 31 13:04:52.070075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.069112    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:52.070075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.069795    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:52.070075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.069981    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:04:52.070940 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:52.070847    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt"
Oct 31 13:04:53.074376 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.074343    4958 generic.go:356] "Generic (PLEG): container finished" podID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerID="51095bc97478eb6ce524fa0200d3bf41ac8b05ed9f2e9325b3448ed89bffa928" exitCode=0
Oct 31 13:04:53.074833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.074440    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6" event={"ID":"7fb909de-a162-4cb5-948b-5ed3fc702618","Type":"ContainerDied","Data":"51095bc97478eb6ce524fa0200d3bf41ac8b05ed9f2e9325b3448ed89bffa928"}
Oct 31 13:04:53.076001 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.075980    4958 generic.go:356] "Generic (PLEG): container finished" podID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerID="a6b41d2bdaf06d6d29c3121ba4f69f7ff78d40d51961922f9662224292e7fcd7" exitCode=0
Oct 31 13:04:53.076067 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.076012    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm" event={"ID":"f6bc722c-d123-4c2b-9b7b-3383a88e75ce","Type":"ContainerDied","Data":"a6b41d2bdaf06d6d29c3121ba4f69f7ff78d40d51961922f9662224292e7fcd7"}
Oct 31 13:04:53.078221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.078196    4958 generic.go:356] "Generic (PLEG): container finished" podID="350bd2fc-7361-4807-96d9-547282b02074" containerID="faa9393352da9a9756b7917e3f64484acf038cf7ffd7ae1e0d952601e206e595" exitCode=0
Oct 31 13:04:53.078310 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.078277    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p" event={"ID":"350bd2fc-7361-4807-96d9-547282b02074","Type":"ContainerDied","Data":"faa9393352da9a9756b7917e3f64484acf038cf7ffd7ae1e0d952601e206e595"}
Oct 31 13:04:53.081701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.081677    4958 generic.go:356] "Generic (PLEG): container finished" podID="efc31819-5834-48cb-8e60-3b395d142ba9" containerID="5b6c9d3cea85300fdfac72c20f57b33dd7e9e1257f6f15bf23fbbcd0980cd742" exitCode=0
Oct 31 13:04:53.081788 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:53.081765    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerDied","Data":"5b6c9d3cea85300fdfac72c20f57b33dd7e9e1257f6f15bf23fbbcd0980cd742"}
Oct 31 13:04:54.092291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.091424    4958 generic.go:356] "Generic (PLEG): container finished" podID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerID="39adfa25dfc018d19288c09e0c389795fa589e42754ac7b1efd1175e5080a42e" exitCode=0
Oct 31 13:04:54.092291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.091526    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx" event={"ID":"442b9aa7-87a1-41dc-a140-ce27bcf2ce99","Type":"ContainerDied","Data":"39adfa25dfc018d19288c09e0c389795fa589e42754ac7b1efd1175e5080a42e"}
Oct 31 13:04:54.100944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.100873    4958 generic.go:356] "Generic (PLEG): container finished" podID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerID="1038b25c045f298eb981d33e710245016c8eb6c655de88e75d42f5eb6190039f" exitCode=0
Oct 31 13:04:54.101072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.100980    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w" event={"ID":"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64","Type":"ContainerDied","Data":"1038b25c045f298eb981d33e710245016c8eb6c655de88e75d42f5eb6190039f"}
Oct 31 13:04:54.107051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.106861    4958 generic.go:356] "Generic (PLEG): container finished" podID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerID="84838586a6cbaf76e806f884a96890f89f04d55bfa837c74a9b611362975e090" exitCode=0
Oct 31 13:04:54.107051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.106937    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6" event={"ID":"7fb909de-a162-4cb5-948b-5ed3fc702618","Type":"ContainerDied","Data":"84838586a6cbaf76e806f884a96890f89f04d55bfa837c74a9b611362975e090"}
Oct 31 13:04:54.111452 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.111427    4958 generic.go:356] "Generic (PLEG): container finished" podID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerID="80af84b1a30546e9be0e2f7a4fa922ff9717950e10f4b24a4df140ae077c9ac4" exitCode=0
Oct 31 13:04:54.112332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:54.111725    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm" event={"ID":"f6bc722c-d123-4c2b-9b7b-3383a88e75ce","Type":"ContainerDied","Data":"80af84b1a30546e9be0e2f7a4fa922ff9717950e10f4b24a4df140ae077c9ac4"}
Oct 31 13:04:55.134367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:55.133384    4958 generic.go:356] "Generic (PLEG): container finished" podID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerID="0128a5c312c7ea159d4d8fd04f578d446cab961f6a20b2cab22cf3c2ed1b3f9c" exitCode=0
Oct 31 13:04:55.134367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:55.133476    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h" event={"ID":"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa","Type":"ContainerDied","Data":"0128a5c312c7ea159d4d8fd04f578d446cab961f6a20b2cab22cf3c2ed1b3f9c"}
Oct 31 13:04:55.146075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:55.146048    4958 generic.go:356] "Generic (PLEG): container finished" podID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerID="4edf67aa0a2befde37e96d40ebdcb252fbd3959f425a11d8efbbc38a844478ce" exitCode=0
Oct 31 13:04:55.146200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:04:55.146189    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll" event={"ID":"7d24ab3e-a385-494e-a7dc-ad499b58f3c5","Type":"ContainerDied","Data":"4edf67aa0a2befde37e96d40ebdcb252fbd3959f425a11d8efbbc38a844478ce"}
Oct 31 13:04:59.601593 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:04:59.601544    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:05:05.277704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:05.277008    4958 generic.go:356] "Generic (PLEG): container finished" podID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerID="e3f6ef5b4779746599aed9159e6a15ae34d03edfe7a63b38489bc31c03cc5a7c" exitCode=0
Oct 31 13:05:05.277704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:05.277183    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w" event={"ID":"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64","Type":"ContainerDied","Data":"e3f6ef5b4779746599aed9159e6a15ae34d03edfe7a63b38489bc31c03cc5a7c"}
Oct 31 13:05:06.292992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.292864    4958 generic.go:356] "Generic (PLEG): container finished" podID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerID="3bfaef00c59b13413e40b903d428fb45bf89f822083cdbf407b34954cd7fb1cd" exitCode=0
Oct 31 13:05:06.293978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.293943    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz" event={"ID":"b8693c32-8b2e-4c32-b262-e9c31129ac18","Type":"ContainerDied","Data":"3bfaef00c59b13413e40b903d428fb45bf89f822083cdbf407b34954cd7fb1cd"}
Oct 31 13:05:06.297215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.297183    4958 generic.go:356] "Generic (PLEG): container finished" podID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerID="80d9a454c8cd56df8d907e8d41c64c3d1a5b153645f0be6cdea0a99bfbd8c155" exitCode=0
Oct 31 13:05:06.297356 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.297330    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx" event={"ID":"442b9aa7-87a1-41dc-a140-ce27bcf2ce99","Type":"ContainerDied","Data":"80d9a454c8cd56df8d907e8d41c64c3d1a5b153645f0be6cdea0a99bfbd8c155"}
Oct 31 13:05:06.305589 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.305555    4958 generic.go:356] "Generic (PLEG): container finished" podID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerID="0b3ce50152139c41dae951f628cb7eb41b5a499bedd49f6b705467c28bef6ac5" exitCode=0
Oct 31 13:05:06.305769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.305692    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm" event={"ID":"f6bc722c-d123-4c2b-9b7b-3383a88e75ce","Type":"ContainerDied","Data":"0b3ce50152139c41dae951f628cb7eb41b5a499bedd49f6b705467c28bef6ac5"}
Oct 31 13:05:06.503204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.503172    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:05:06.587686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.586774    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\") pod \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") "
Oct 31 13:05:06.587686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.586842    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\" (UniqueName: \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\") pod \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") "
Oct 31 13:05:06.587686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.586895    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\") pod \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\" (UID: \"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64\") "
Oct 31 13:05:06.588752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.588720    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle" pod "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" (UID: "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:06.592875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.592849    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787" pod "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" (UID: "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64"). InnerVolumeSpecName "kube-api-access-tq787". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:06.593501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.593479    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util" pod "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" (UID: "18cdcb2c-75d9-42ad-a61b-ba4bf3670f64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:06.688264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.688229    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:06.688264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.688265    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:06.688474 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:06.688277    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq787\" (UniqueName: \"kubernetes.io/projected/18cdcb2c-75d9-42ad-a61b-ba4bf3670f64-kube-api-access-tq787\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.318308 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.318259    4958 generic.go:356] "Generic (PLEG): container finished" podID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerID="8b971b50e098e63410825dc898cfc0e768972742bb816dbe42d04143632fd41d" exitCode=0
Oct 31 13:05:07.318812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.318431    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h" event={"ID":"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa","Type":"ContainerDied","Data":"8b971b50e098e63410825dc898cfc0e768972742bb816dbe42d04143632fd41d"}
Oct 31 13:05:07.322801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.322720    4958 generic.go:356] "Generic (PLEG): container finished" podID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerID="4e905b34d64aa4317bf7b13cea0ddf7a38c357fa34e6e90f53179ba94758a276" exitCode=0
Oct 31 13:05:07.323023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.322991    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll" event={"ID":"7d24ab3e-a385-494e-a7dc-ad499b58f3c5","Type":"ContainerDied","Data":"4e905b34d64aa4317bf7b13cea0ddf7a38c357fa34e6e90f53179ba94758a276"}
Oct 31 13:05:07.327006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.326968    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w" event={"ID":"18cdcb2c-75d9-42ad-a61b-ba4bf3670f64","Type":"ContainerDied","Data":"746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a"}
Oct 31 13:05:07.327006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.326993    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c29x7w"
Oct 31 13:05:07.327212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.327022    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="746dd219c05880e3e31897cb9329dd15df0e3bd79ecf3946876d5fe2ab53398a"
Oct 31 13:05:07.329952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.329922    4958 generic.go:356] "Generic (PLEG): container finished" podID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerID="487feed0d9f9997c26a003b44617c101e44fb487533b02a080fcc68707184a0e" exitCode=0
Oct 31 13:05:07.330394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.330371    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6" event={"ID":"7fb909de-a162-4cb5-948b-5ed3fc702618","Type":"ContainerDied","Data":"487feed0d9f9997c26a003b44617c101e44fb487533b02a080fcc68707184a0e"}
Oct 31 13:05:07.538544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.538504    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:05:07.582739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.582691    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:05:07.597984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.597949    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\") pod \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") "
Oct 31 13:05:07.598168 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.598023    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\" (UniqueName: \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\") pod \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") "
Oct 31 13:05:07.598168 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.598098    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\") pod \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\" (UID: \"442b9aa7-87a1-41dc-a140-ce27bcf2ce99\") "
Oct 31 13:05:07.598738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.598710    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:05:07.598887 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.598858    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle" pod "442b9aa7-87a1-41dc-a140-ce27bcf2ce99" (UID: "442b9aa7-87a1-41dc-a140-ce27bcf2ce99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.603373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.603326    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util" pod "442b9aa7-87a1-41dc-a140-ce27bcf2ce99" (UID: "442b9aa7-87a1-41dc-a140-ce27bcf2ce99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.605071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.605039    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c" pod "442b9aa7-87a1-41dc-a140-ce27bcf2ce99" (UID: "442b9aa7-87a1-41dc-a140-ce27bcf2ce99"). InnerVolumeSpecName "kube-api-access-s2t5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.698825    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\" (UniqueName: \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\") pod \"b8693c32-8b2e-4c32-b262-e9c31129ac18\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.698895    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\") pod \"b8693c32-8b2e-4c32-b262-e9c31129ac18\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.698945    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\" (UniqueName: \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\") pod \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699024    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\") pod \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699060    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\") pod \"b8693c32-8b2e-4c32-b262-e9c31129ac18\" (UID: \"b8693c32-8b2e-4c32-b262-e9c31129ac18\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699090    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\") pod \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\" (UID: \"f6bc722c-d123-4c2b-9b7b-3383a88e75ce\") "
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699316    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699340    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.699697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.699357    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2t5c\" (UniqueName: \"kubernetes.io/projected/442b9aa7-87a1-41dc-a140-ce27bcf2ce99-kube-api-access-s2t5c\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.700504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.700451    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle" pod "f6bc722c-d123-4c2b-9b7b-3383a88e75ce" (UID: "f6bc722c-d123-4c2b-9b7b-3383a88e75ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.701416 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.701384    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle" pod "b8693c32-8b2e-4c32-b262-e9c31129ac18" (UID: "b8693c32-8b2e-4c32-b262-e9c31129ac18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.701922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.701886    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd" pod "b8693c32-8b2e-4c32-b262-e9c31129ac18" (UID: "b8693c32-8b2e-4c32-b262-e9c31129ac18"). InnerVolumeSpecName "kube-api-access-n6hrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:07.702336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.702310    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s" pod "f6bc722c-d123-4c2b-9b7b-3383a88e75ce" (UID: "f6bc722c-d123-4c2b-9b7b-3383a88e75ce"). InnerVolumeSpecName "kube-api-access-7wh4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:07.706086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.706047    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util" pod "b8693c32-8b2e-4c32-b262-e9c31129ac18" (UID: "b8693c32-8b2e-4c32-b262-e9c31129ac18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.707054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.707018    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util" pod "f6bc722c-d123-4c2b-9b7b-3383a88e75ce" (UID: "f6bc722c-d123-4c2b-9b7b-3383a88e75ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:07.800358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800323    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.800358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800355    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.800562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800368    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.800562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800383    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6hrd\" (UniqueName: \"kubernetes.io/projected/b8693c32-8b2e-4c32-b262-e9c31129ac18-kube-api-access-n6hrd\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.800562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800394    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8693c32-8b2e-4c32-b262-e9c31129ac18-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:07.800562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:07.800402    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wh4s\" (UniqueName: \"kubernetes.io/projected/f6bc722c-d123-4c2b-9b7b-3383a88e75ce-kube-api-access-7wh4s\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.341346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.341255    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm" event={"ID":"f6bc722c-d123-4c2b-9b7b-3383a88e75ce","Type":"ContainerDied","Data":"8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53"}
Oct 31 13:05:08.341346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.341325    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644l5vvm"
Oct 31 13:05:08.341839 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.341359    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d205256c6fd2b0f4c9458f57ef513a3d1be589154c5ef4e25e4ab5523697f53"
Oct 31 13:05:08.343587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.343556    4958 generic.go:356] "Generic (PLEG): container finished" podID="350bd2fc-7361-4807-96d9-547282b02074" containerID="44c0d92de1ab47ac07c48fb4b11c8880f5e869659f3ea2c932e98bbdb0fa1eb6" exitCode=0
Oct 31 13:05:08.343733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.343641    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p" event={"ID":"350bd2fc-7361-4807-96d9-547282b02074","Type":"ContainerDied","Data":"44c0d92de1ab47ac07c48fb4b11c8880f5e869659f3ea2c932e98bbdb0fa1eb6"}
Oct 31 13:05:08.345965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.345934    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerStarted","Data":"488df26036bce4423694925999f002497fe110d6ed4ba84f8caffc8eb06b7e90"}
Oct 31 13:05:08.348103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.348073    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz" event={"ID":"b8693c32-8b2e-4c32-b262-e9c31129ac18","Type":"ContainerDied","Data":"1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2"}
Oct 31 13:05:08.348248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.348120    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1766e66152d7c80184d9007e12ee0fb5dada73f4dd6de6708fb05bd880e8a5c2"
Oct 31 13:05:08.348248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.348125    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be716r5jz"
Oct 31 13:05:08.350080 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.350058    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx"
Oct 31 13:05:08.350186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.350093    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6df6fx" event={"ID":"442b9aa7-87a1-41dc-a140-ce27bcf2ce99","Type":"ContainerDied","Data":"5c12e1a697b9a5f9183644bed8584b394a4a499bcae7446b2f091f062911191e"}
Oct 31 13:05:08.350186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.350130    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c12e1a697b9a5f9183644bed8584b394a4a499bcae7446b2f091f062911191e"
Oct 31 13:05:08.395000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.394937    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" podStartSLOduration=3.263542697 podStartE2EDuration="35.394917407s" totalImagesPullingTime="32.13137471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:04:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:08.394116584 +0000 UTC m=+330.057542271" watchObservedRunningTime="2026-10-31 13:05:08.394917407 +0000 UTC m=+330.058343094"
Oct 31 13:05:08.540092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.540068    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:05:08.560330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.560298    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:05:08.571084 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.571057    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:05:08.609072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.608977    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\") pod \"7fb909de-a162-4cb5-948b-5ed3fc702618\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") "
Oct 31 13:05:08.609072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609017    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\") pod \"7fb909de-a162-4cb5-948b-5ed3fc702618\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") "
Oct 31 13:05:08.609072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609057    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\" (UniqueName: \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\") pod \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") "
Oct 31 13:05:08.609353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609084    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\" (UniqueName: \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\") pod \"7fb909de-a162-4cb5-948b-5ed3fc702618\" (UID: \"7fb909de-a162-4cb5-948b-5ed3fc702618\") "
Oct 31 13:05:08.609353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609145    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\") pod \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") "
Oct 31 13:05:08.609353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609170    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\") pod \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") "
Oct 31 13:05:08.609353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609302    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\") pod \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") "
Oct 31 13:05:08.609565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609365    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\") pod \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\" (UID: \"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa\") "
Oct 31 13:05:08.609565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.609400    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\" (UniqueName: \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\") pod \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\" (UID: \"7d24ab3e-a385-494e-a7dc-ad499b58f3c5\") "
Oct 31 13:05:08.610537 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.610502    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle" pod "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" (UID: "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.610537 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.610516    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle" pod "7fb909de-a162-4cb5-948b-5ed3fc702618" (UID: "7fb909de-a162-4cb5-948b-5ed3fc702618"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.610806 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.610773    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle" pod "7d24ab3e-a385-494e-a7dc-ad499b58f3c5" (UID: "7d24ab3e-a385-494e-a7dc-ad499b58f3c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.612208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.612171    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2" pod "7fb909de-a162-4cb5-948b-5ed3fc702618" (UID: "7fb909de-a162-4cb5-948b-5ed3fc702618"). InnerVolumeSpecName "kube-api-access-pnsq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:08.612616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.612581    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr" pod "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" (UID: "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa"). InnerVolumeSpecName "kube-api-access-v9rzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:08.612804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.612779    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2" pod "7d24ab3e-a385-494e-a7dc-ad499b58f3c5" (UID: "7d24ab3e-a385-494e-a7dc-ad499b58f3c5"). InnerVolumeSpecName "kube-api-access-xfjt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:08.616720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.616695    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util" pod "7d24ab3e-a385-494e-a7dc-ad499b58f3c5" (UID: "7d24ab3e-a385-494e-a7dc-ad499b58f3c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.617786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.617761    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util" pod "7fb909de-a162-4cb5-948b-5ed3fc702618" (UID: "7fb909de-a162-4cb5-948b-5ed3fc702618"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.618281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.618256    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util" pod "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" (UID: "edabf7a4-563c-4b7f-9e49-0ad5fff03cfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:08.710895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710852    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.710895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710885    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fb909de-a162-4cb5-948b-5ed3fc702618-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.710895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710896    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9rzr\" (UniqueName: \"kubernetes.io/projected/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-kube-api-access-v9rzr\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.710895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710907    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnsq2\" (UniqueName: \"kubernetes.io/projected/7fb909de-a162-4cb5-948b-5ed3fc702618-kube-api-access-pnsq2\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.711166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710916    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.711166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710926    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.711166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710933    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.711166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710941    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edabf7a4-563c-4b7f-9e49-0ad5fff03cfa-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:08.711166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:08.710949    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfjt2\" (UniqueName: \"kubernetes.io/projected/7d24ab3e-a385-494e-a7dc-ad499b58f3c5-kube-api-access-xfjt2\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:09.357179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.357146    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll"
Oct 31 13:05:09.357179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.357160    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75vpll" event={"ID":"7d24ab3e-a385-494e-a7dc-ad499b58f3c5","Type":"ContainerDied","Data":"b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332"}
Oct 31 13:05:09.357591 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.357220    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b991498efbdeaa5197f9bdc7b8668e6892d95d021e6dd72933ec427356bdf332"
Oct 31 13:05:09.359079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.359057    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6"
Oct 31 13:05:09.359197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.359087    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651chgcp6" event={"ID":"7fb909de-a162-4cb5-948b-5ed3fc702618","Type":"ContainerDied","Data":"02df36843b03861956c839103e6930acfc8eb31c197fc8e523dccb976280e876"}
Oct 31 13:05:09.359197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.359131    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02df36843b03861956c839103e6930acfc8eb31c197fc8e523dccb976280e876"
Oct 31 13:05:09.361157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.361138    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h"
Oct 31 13:05:09.361157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.361147    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avdj6h" event={"ID":"edabf7a4-563c-4b7f-9e49-0ad5fff03cfa","Type":"ContainerDied","Data":"f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81"}
Oct 31 13:05:09.361328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.361185    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4c2d544e12b509600ee0161cae723a838e6446b4f1deff4f5daae75685b3a81"
Oct 31 13:05:09.363525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.363496    4958 generic.go:356] "Generic (PLEG): container finished" podID="efc31819-5834-48cb-8e60-3b395d142ba9" containerID="488df26036bce4423694925999f002497fe110d6ed4ba84f8caffc8eb06b7e90" exitCode=0
Oct 31 13:05:09.363668 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.363529    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerDied","Data":"488df26036bce4423694925999f002497fe110d6ed4ba84f8caffc8eb06b7e90"}
Oct 31 13:05:09.509010 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.508980    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:05:09.620188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.620096    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\") pod \"350bd2fc-7361-4807-96d9-547282b02074\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") "
Oct 31 13:05:09.620354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.620199    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\" (UniqueName: \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\") pod \"350bd2fc-7361-4807-96d9-547282b02074\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") "
Oct 31 13:05:09.620354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.620267    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\") pod \"350bd2fc-7361-4807-96d9-547282b02074\" (UID: \"350bd2fc-7361-4807-96d9-547282b02074\") "
Oct 31 13:05:09.620852 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.620824    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle" pod "350bd2fc-7361-4807-96d9-547282b02074" (UID: "350bd2fc-7361-4807-96d9-547282b02074"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:09.622492 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.622463    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf" pod "350bd2fc-7361-4807-96d9-547282b02074" (UID: "350bd2fc-7361-4807-96d9-547282b02074"). InnerVolumeSpecName "kube-api-access-lccnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:09.628367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.628318    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util" pod "350bd2fc-7361-4807-96d9-547282b02074" (UID: "350bd2fc-7361-4807-96d9-547282b02074"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:09.721761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.721723    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:09.721761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.721756    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lccnf\" (UniqueName: \"kubernetes.io/projected/350bd2fc-7361-4807-96d9-547282b02074-kube-api-access-lccnf\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:09.721761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:09.721766    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350bd2fc-7361-4807-96d9-547282b02074-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:10.032912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.032874    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:10.196643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.196593    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:10.371924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.371833    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p" event={"ID":"350bd2fc-7361-4807-96d9-547282b02074","Type":"ContainerDied","Data":"e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945"}
Oct 31 13:05:10.371924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.371860    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cvbm5p"
Oct 31 13:05:10.371924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.371886    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e45b515c28509c3a9a0f3cc603ae455c76f9e099151cf044824890cc3c2f3945"
Oct 31 13:05:10.442297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.442239    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:10.522999 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.522970    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:05:10.628986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.628901    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\" (UniqueName: \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\") pod \"efc31819-5834-48cb-8e60-3b395d142ba9\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") "
Oct 31 13:05:10.629153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.629012    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\") pod \"efc31819-5834-48cb-8e60-3b395d142ba9\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") "
Oct 31 13:05:10.629153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.629067    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\") pod \"efc31819-5834-48cb-8e60-3b395d142ba9\" (UID: \"efc31819-5834-48cb-8e60-3b395d142ba9\") "
Oct 31 13:05:10.629426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.629393    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle" pod "efc31819-5834-48cb-8e60-3b395d142ba9" (UID: "efc31819-5834-48cb-8e60-3b395d142ba9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:10.631082 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.631060    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj" pod "efc31819-5834-48cb-8e60-3b395d142ba9" (UID: "efc31819-5834-48cb-8e60-3b395d142ba9"). InnerVolumeSpecName "kube-api-access-stkzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:05:10.634750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.634723    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util" pod "efc31819-5834-48cb-8e60-3b395d142ba9" (UID: "efc31819-5834-48cb-8e60-3b395d142ba9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:05:10.730257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.730212    4958 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-bundle\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:10.730257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.730249    4958 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efc31819-5834-48cb-8e60-3b395d142ba9-util\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:10.730257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.730259    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stkzj\" (UniqueName: \"kubernetes.io/projected/efc31819-5834-48cb-8e60-3b395d142ba9-kube-api-access-stkzj\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:05:10.885965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.885882    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:10.936994 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.936958    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"]
Oct 31 13:05:10.937306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937291    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="util"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937308    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="util"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937319    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="extract"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937325    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="extract"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937333    4958 cpu_manager.go:414] "containerMap: removing container" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="util"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937338    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="util"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937346    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="pull"
Oct 31 13:05:10.937351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937351    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937358    4958 cpu_manager.go:414] "containerMap: removing container" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937363    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937371    4958 cpu_manager.go:414] "containerMap: removing container" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937377    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937390    4958 cpu_manager.go:414] "containerMap: removing container" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937394    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937402    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937406    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937412    4958 cpu_manager.go:414] "containerMap: removing container" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937416    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937423    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937428    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937434    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937438    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937444    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937449    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937459    4958 cpu_manager.go:414] "containerMap: removing container" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937466    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937474    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937480    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937485    4958 cpu_manager.go:414] "containerMap: removing container" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937489    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937500    4958 cpu_manager.go:414] "containerMap: removing container" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937505    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937510    4958 cpu_manager.go:414] "containerMap: removing container" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937515    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="pull"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937520    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937525    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937536    4958 cpu_manager.go:414] "containerMap: removing container" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937544    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937550    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937555    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="util"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937560    4958 cpu_manager.go:414] "containerMap: removing container" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="extract"
Oct 31 13:05:10.937550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937565    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937572    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="pull"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937576    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="pull"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937584    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937589    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937595    4958 cpu_manager.go:414] "containerMap: removing container" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937599    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937623    4958 cpu_manager.go:414] "containerMap: removing container" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="util"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937629    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="util"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937635    4958 cpu_manager.go:414] "containerMap: removing container" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937639    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937644    4958 cpu_manager.go:414] "containerMap: removing container" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937648    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937707    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="350bd2fc-7361-4807-96d9-547282b02074" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937715    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="442b9aa7-87a1-41dc-a140-ce27bcf2ce99" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937722    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6bc722c-d123-4c2b-9b7b-3383a88e75ce" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937729    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="18cdcb2c-75d9-42ad-a61b-ba4bf3670f64" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937735    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d24ab3e-a385-494e-a7dc-ad499b58f3c5" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937741    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fb909de-a162-4cb5-948b-5ed3fc702618" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937747    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="efc31819-5834-48cb-8e60-3b395d142ba9" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937753    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8693c32-8b2e-4c32-b262-e9c31129ac18" containerName="extract"
Oct 31 13:05:10.938501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.937757    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="edabf7a4-563c-4b7f-9e49-0ad5fff03cfa" containerName="extract"
Oct 31 13:05:10.939838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.939821    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:10.951781 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.951749    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 13:05:10.951781 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.951777    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 13:05:10.951940 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.951923    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 13:05:10.952064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.952052    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 31 13:05:10.952197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.952168    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-9qk9g\""
Oct 31 13:05:10.952379 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.952367    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 13:05:10.983808 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:10.983770    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"]
Oct 31 13:05:11.032800 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.032761    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-webhook-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.032800 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.032811    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-manifests\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.033030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.032842    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-metrics-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.033030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.032943    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-tmp\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.033030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.032987    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.033141 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.033072    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2plx\" (UniqueName: \"kubernetes.io/projected/1fb918ae-537d-43d7-9754-383fe9478f18-kube-api-access-p2plx\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.080478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.080443    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:11.134141 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134102    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2plx\" (UniqueName: \"kubernetes.io/projected/1fb918ae-537d-43d7-9754-383fe9478f18-kube-api-access-p2plx\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134264    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-webhook-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134307    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-manifests\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134334    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-metrics-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134359    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-tmp\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134483 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134395    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.134770 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.134747    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-manifests\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.136811 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.136758    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fb918ae-537d-43d7-9754-383fe9478f18-tmp\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.137110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.137090    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-metrics-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.137159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.137142    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.137195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.137138    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fb918ae-537d-43d7-9754-383fe9478f18-webhook-cert\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.148401 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.148378    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2plx\" (UniqueName: \"kubernetes.io/projected/1fb918ae-537d-43d7-9754-383fe9478f18-kube-api-access-p2plx\") pod \"opendatahub-operator-controller-manager-849556f89d-jjxvk\" (UID: \"1fb918ae-537d-43d7-9754-383fe9478f18\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.228767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.228732    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:11.253065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.253029    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:11.379578 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.379548    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp"
Oct 31 13:05:11.380103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.379576    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644gjddp" event={"ID":"efc31819-5834-48cb-8e60-3b395d142ba9","Type":"ContainerDied","Data":"b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459"}
Oct 31 13:05:11.380103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.379679    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b678256e39b5abf3340e7d8fd12d888483c15b6b3ff9679b98a8429dbd0fe459"
Oct 31 13:05:11.380103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.379801    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:11.560054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.560022    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:11.603508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:11.603444    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"]
Oct 31 13:05:11.605957 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:11.605912    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb918ae_537d_43d7_9754_383fe9478f18.slice/crio-29cacb7313f43dab9b8bfccb8becb550ff9d38885813aae7171b8440661a8508 WatchSource:0}: Error finding container 29cacb7313f43dab9b8bfccb8becb550ff9d38885813aae7171b8440661a8508: Status 404 returned error can't find the container with id 29cacb7313f43dab9b8bfccb8becb550ff9d38885813aae7171b8440661a8508
Oct 31 13:05:12.387999 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:12.387957    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk" event={"ID":"1fb918ae-537d-43d7-9754-383fe9478f18","Type":"ContainerStarted","Data":"29cacb7313f43dab9b8bfccb8becb550ff9d38885813aae7171b8440661a8508"}
Oct 31 13:05:13.716570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:13.716529    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:13.864285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:13.864242    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:14.040003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:14.039918    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:14.185833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:14.185798    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:15.408693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:15.408653    4958 generic.go:356] "Generic (PLEG): container finished" podID="1fb918ae-537d-43d7-9754-383fe9478f18" containerID="9c4ec36f6f86cee57d7e13a74736c2f0205e5b5f3f71fe56b762d04aa6bb716d" exitCode=0
Oct 31 13:05:15.409112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:15.408745    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk" event={"ID":"1fb918ae-537d-43d7-9754-383fe9478f18","Type":"ContainerDied","Data":"9c4ec36f6f86cee57d7e13a74736c2f0205e5b5f3f71fe56b762d04aa6bb716d"}
Oct 31 13:05:16.415361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.415314    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk" event={"ID":"1fb918ae-537d-43d7-9754-383fe9478f18","Type":"ContainerStarted","Data":"93968288b8470b882ddd4a9ff81e0a13c85232ee2560f0a418503f5b508f1121"}
Oct 31 13:05:16.415891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.415419    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:16.471210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.471172    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"]
Oct 31 13:05:16.473527 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.473502    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.479332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.479306    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-6x224\""
Oct 31 13:05:16.480112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.480073    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 31 13:05:16.480245 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.480160    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 31 13:05:16.508094 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.508060    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"]
Oct 31 13:05:16.540732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.540665    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk" podStartSLOduration=2.453621525 podStartE2EDuration="6.540642458s" totalImagesPullingTime="3.676561566s" totalInitContainerRuntime="410.459367ms" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:16.534191284 +0000 UTC m=+338.197616988" watchObservedRunningTime="2026-10-31 13:05:16.540642458 +0000 UTC m=+338.204068144"
Oct 31 13:05:16.580767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.580730    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86528eb1-0135-48e3-9f14-a03c01b3349e-tmp\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.580767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.580771    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxq6\" (UniqueName: \"kubernetes.io/projected/86528eb1-0135-48e3-9f14-a03c01b3349e-kube-api-access-nwxq6\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.682128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.682036    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86528eb1-0135-48e3-9f14-a03c01b3349e-tmp\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.682128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.682080    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxq6\" (UniqueName: \"kubernetes.io/projected/86528eb1-0135-48e3-9f14-a03c01b3349e-kube-api-access-nwxq6\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.682532 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.682511    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86528eb1-0135-48e3-9f14-a03c01b3349e-tmp\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.700562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.700523    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxq6\" (UniqueName: \"kubernetes.io/projected/86528eb1-0135-48e3-9f14-a03c01b3349e-kube-api-access-nwxq6\") pod \"jobset-operator-674cd59dc5-8c9tx\" (UID: \"86528eb1-0135-48e3-9f14-a03c01b3349e\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:16.795727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:16.795684    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"
Oct 31 13:05:17.090199 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:17.090146    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx"]
Oct 31 13:05:17.097653 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:17.097616    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86528eb1_0135_48e3_9f14_a03c01b3349e.slice/crio-5b032754965055a0b80205c123d39b2d8ddc2b6c38ab7cb6b66125ea7bb5fa04 WatchSource:0}: Error finding container 5b032754965055a0b80205c123d39b2d8ddc2b6c38ab7cb6b66125ea7bb5fa04: Status 404 returned error can't find the container with id 5b032754965055a0b80205c123d39b2d8ddc2b6c38ab7cb6b66125ea7bb5fa04
Oct 31 13:05:17.421828 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:17.421733    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx" event={"ID":"86528eb1-0135-48e3-9f14-a03c01b3349e","Type":"ContainerStarted","Data":"5b032754965055a0b80205c123d39b2d8ddc2b6c38ab7cb6b66125ea7bb5fa04"}
Oct 31 13:05:18.467177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:18.467136    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:19.372450 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:19.372416    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:19.529935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:19.529896    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:20.439370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:20.439327    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx" event={"ID":"86528eb1-0135-48e3-9f14-a03c01b3349e","Type":"ContainerStarted","Data":"c41c60764321823adf86355a4b155754098fadeffb83f69633e012b377e23b3c"}
Oct 31 13:05:20.471735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:20.471672    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-8c9tx" podStartSLOduration=2.190037536 podStartE2EDuration="4.471654236s" totalImagesPullingTime="2.2816167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:20.470133656 +0000 UTC m=+342.133559362" watchObservedRunningTime="2026-10-31 13:05:20.471654236 +0000 UTC m=+342.135079921"
Oct 31 13:05:21.688375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.688333    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"]
Oct 31 13:05:21.691856 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.691828    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.701160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.701115    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 13:05:21.701312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.701199    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qp5g6\""
Oct 31 13:05:21.701312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.701210    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 13:05:21.728194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.728159    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"]
Oct 31 13:05:21.834994 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.834951    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdb6h\" (UniqueName: \"kubernetes.io/projected/0d06a32a-f9fb-441d-a173-2a37d27bc389-kube-api-access-cdb6h\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.835176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.835083    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d06a32a-f9fb-441d-a173-2a37d27bc389-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.935572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.935529    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d06a32a-f9fb-441d-a173-2a37d27bc389-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.935748 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.935585    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdb6h\" (UniqueName: \"kubernetes.io/projected/0d06a32a-f9fb-441d-a173-2a37d27bc389-kube-api-access-cdb6h\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.935979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.935956    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d06a32a-f9fb-441d-a173-2a37d27bc389-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:21.951435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:21.951360    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdb6h\" (UniqueName: \"kubernetes.io/projected/0d06a32a-f9fb-441d-a173-2a37d27bc389-kube-api-access-cdb6h\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw\" (UID: \"0d06a32a-f9fb-441d-a173-2a37d27bc389\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:22.004297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:22.004254    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"
Oct 31 13:05:22.302493 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:22.302468    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw"]
Oct 31 13:05:22.303968 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:22.303937    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d06a32a_f9fb_441d_a173_2a37d27bc389.slice/crio-0dc08a6fd2523507530df53f57104e74d4f359bddcdf1cc908d792e59758f07e WatchSource:0}: Error finding container 0dc08a6fd2523507530df53f57104e74d4f359bddcdf1cc908d792e59758f07e: Status 404 returned error can't find the container with id 0dc08a6fd2523507530df53f57104e74d4f359bddcdf1cc908d792e59758f07e
Oct 31 13:05:22.455827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:22.455787    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw" event={"ID":"0d06a32a-f9fb-441d-a173-2a37d27bc389","Type":"ContainerStarted","Data":"0dc08a6fd2523507530df53f57104e74d4f359bddcdf1cc908d792e59758f07e"}
Oct 31 13:05:24.409591 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:24.409554    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:24.468342 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:24.468297    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw" event={"ID":"0d06a32a-f9fb-441d-a173-2a37d27bc389","Type":"ContainerStarted","Data":"98c1433108f8443f00c80fbb6adfd1cdc6cc6de5e3efb2b3c371d5fb8b030671"}
Oct 31 13:05:24.498091 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:24.497945    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-t2bqw" podStartSLOduration=1.582937871 podStartE2EDuration="3.49792871s" totalImagesPullingTime="1.914990839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:24.495151051 +0000 UTC m=+346.158576733" watchObservedRunningTime="2026-10-31 13:05:24.49792871 +0000 UTC m=+346.161354394"
Oct 31 13:05:25.737008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:25.736962    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:25.978411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:25.978376    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:26.244447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:26.244419    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:26.512298 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:26.512206    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:26.791179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:26.791099    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:26.972684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:26.972648    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:27.350579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:27.350526    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:27.425048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:27.425016    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-849556f89d-jjxvk"
Oct 31 13:05:27.538365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:27.538326    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:28.529838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:28.529797    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:28.786959 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:28.786870    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:28.974155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:28.974120    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:29.574468 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:05:29.574419    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:05:32.132701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.132664    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:05:32.137295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.137269    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.143421 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.143396    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-62gxj\""
Oct 31 13:05:32.145892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.145870    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 13:05:32.146029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.146009    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 13:05:32.149835 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.149811    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:05:32.229763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.229715    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9p9\" (UniqueName: \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.229763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.229762    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.330978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.330934    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9p9\" (UniqueName: \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.331195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.330983    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.331369 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.331348    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.346135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.346106    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9p9\" (UniqueName: \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\") pod \"kuadrant-operator-controller-manager-cf8469d7b-4vz9t\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.450410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.450310    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:32.741673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.741644    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:05:32.744075 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:32.744043    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e232fc_649a_41dd_9f30_28a459256cc6.slice/crio-bfc0561d9abaa65baaa4db7a1d2104f7dbcdccf7b7c36cee069244527318c9e8 WatchSource:0}: Error finding container bfc0561d9abaa65baaa4db7a1d2104f7dbcdccf7b7c36cee069244527318c9e8: Status 404 returned error can't find the container with id bfc0561d9abaa65baaa4db7a1d2104f7dbcdccf7b7c36cee069244527318c9e8
Oct 31 13:05:32.876570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:32.876530    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:33.153056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:33.152976    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:33.517078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:33.517039    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" event={"ID":"84e232fc-649a-41dd-9f30-28a459256cc6","Type":"ContainerStarted","Data":"bfc0561d9abaa65baaa4db7a1d2104f7dbcdccf7b7c36cee069244527318c9e8"}
Oct 31 13:05:34.360204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:34.360165    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:34.535261 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:34.535214    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:35.703445 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.703404    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"]
Oct 31 13:05:35.730890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.730852    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"]
Oct 31 13:05:35.731072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.730995    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:35.736357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.736325    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 13:05:35.736540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.736518    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-d485b\""
Oct 31 13:05:35.863726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.863682    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4qtx\" (UniqueName: \"kubernetes.io/projected/c3bc6ec3-6986-487c-bb9e-76e54343d380-kube-api-access-s4qtx\") pod \"dns-operator-controller-manager-8557cbdb84-vwpqq\" (UID: \"c3bc6ec3-6986-487c-bb9e-76e54343d380\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:35.964355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.964305    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qtx\" (UniqueName: \"kubernetes.io/projected/c3bc6ec3-6986-487c-bb9e-76e54343d380-kube-api-access-s4qtx\") pod \"dns-operator-controller-manager-8557cbdb84-vwpqq\" (UID: \"c3bc6ec3-6986-487c-bb9e-76e54343d380\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:35.979165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:35.979090    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4qtx\" (UniqueName: \"kubernetes.io/projected/c3bc6ec3-6986-487c-bb9e-76e54343d380-kube-api-access-s4qtx\") pod \"dns-operator-controller-manager-8557cbdb84-vwpqq\" (UID: \"c3bc6ec3-6986-487c-bb9e-76e54343d380\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:36.051651 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:36.051584    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:36.236526 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:36.236423    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:36.347109 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:36.347057    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"]
Oct 31 13:05:36.349488 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:36.349459    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bc6ec3_6986_487c_bb9e_76e54343d380.slice/crio-eddfbd2f045eaf173306b365f934e3ef3340954353f3844f6c23b1fcdf472ac5 WatchSource:0}: Error finding container eddfbd2f045eaf173306b365f934e3ef3340954353f3844f6c23b1fcdf472ac5: Status 404 returned error can't find the container with id eddfbd2f045eaf173306b365f934e3ef3340954353f3844f6c23b1fcdf472ac5
Oct 31 13:05:36.536108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:36.536009    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:36.536108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:36.536059    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq" event={"ID":"c3bc6ec3-6986-487c-bb9e-76e54343d380","Type":"ContainerStarted","Data":"eddfbd2f045eaf173306b365f934e3ef3340954353f3844f6c23b1fcdf472ac5"}
Oct 31 13:05:37.082876 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.082842    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:37.403350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.403272    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"]
Oct 31 13:05:37.411172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.411142    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.448559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.448519    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"]
Oct 31 13:05:37.485388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.485320    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 31 13:05:37.485388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.485339    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9nhp8\""
Oct 31 13:05:37.485784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.485535    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 31 13:05:37.486895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.486866    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:37.581564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.581527    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tls-certs\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.581564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.581567    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tmp\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.581840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.581694    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhxl\" (UniqueName: \"kubernetes.io/projected/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-kube-api-access-srhxl\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.683052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.682964    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tls-certs\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.683052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.683014    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tmp\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.683286 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.683060    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srhxl\" (UniqueName: \"kubernetes.io/projected/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-kube-api-access-srhxl\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.686232 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.686205    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tls-certs\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.686566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.686544    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-tmp\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.706926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.706892    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhxl\" (UniqueName: \"kubernetes.io/projected/db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7-kube-api-access-srhxl\") pod \"kube-auth-proxy-776d875d45-zhg8v\" (UID: \"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7\") " pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.735923 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.735780    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"]
Oct 31 13:05:37.739707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.738871    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.741495 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.741467    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"
Oct 31 13:05:37.749215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.747718    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s28wc\""
Oct 31 13:05:37.765469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.761759    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"]
Oct 31 13:05:37.837143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.837056    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886042    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886151    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886184    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886214    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbss\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-kube-api-access-bwbss\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886246    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886306    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.886340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886335    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.887304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886376    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.887304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.886416    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987594    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987685    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987704    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987723    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbss\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-kube-api-access-bwbss\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987745    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987775    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987794    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987819    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.987841    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.988701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.988178    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.989953    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.990897    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.991153    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.991194    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.991470    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:37.991563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:37.991485    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:38.013548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.013450    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbss\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-kube-api-access-bwbss\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:38.015750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.015715    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6c277b4-6402-4ff1-b618-a5ddfcace48f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf\" (UID: \"a6c277b4-6402-4ff1-b618-a5ddfcace48f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:38.024582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.024549    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:38.053434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.053346    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776d875d45-zhg8v"]
Oct 31 13:05:38.057640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.057447    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:38.370510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.362859    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"]
Oct 31 13:05:38.373433 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:38.373393    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c277b4_6402_4ff1_b618_a5ddfcace48f.slice/crio-388b4bb2e8b633a39293966563394818639fe76d9deabb128e1acb4960e81553 WatchSource:0}: Error finding container 388b4bb2e8b633a39293966563394818639fe76d9deabb128e1acb4960e81553: Status 404 returned error can't find the container with id 388b4bb2e8b633a39293966563394818639fe76d9deabb128e1acb4960e81553
Oct 31 13:05:38.378071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.378030    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:05:38.378171 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.378127    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:05:38.378230 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.378170    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:05:38.555759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.555654    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf" event={"ID":"a6c277b4-6402-4ff1-b618-a5ddfcace48f","Type":"ContainerStarted","Data":"35de80c6701d67055972aae10ea4baa14baed9b797f16a1b187fe1edb5dd341d"}
Oct 31 13:05:38.555759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.555732    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf" event={"ID":"a6c277b4-6402-4ff1-b618-a5ddfcace48f","Type":"ContainerStarted","Data":"388b4bb2e8b633a39293966563394818639fe76d9deabb128e1acb4960e81553"}
Oct 31 13:05:38.557518 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.557486    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v" event={"ID":"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7","Type":"ContainerStarted","Data":"a82eb6a9b7c655bc872a76dbdd867119c448b6d39df23e8d2c437f1b4d325b75"}
Oct 31 13:05:38.616478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:38.616407    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf" podStartSLOduration=1.616386758 podStartE2EDuration="1.616386758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:38.61228956 +0000 UTC m=+360.275715246" watchObservedRunningTime="2026-10-31 13:05:38.616386758 +0000 UTC m=+360.279812449"
Oct 31 13:05:39.031365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.031332    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 13:05:39.060829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.060537    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:39.066826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.066790    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:39.276072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.275936    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:39.449196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.449154    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:39.565756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.565667    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" event={"ID":"84e232fc-649a-41dd-9f30-28a459256cc6","Type":"ContainerStarted","Data":"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"}
Oct 31 13:05:39.565756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.565737    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:39.567577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.567526    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq" event={"ID":"c3bc6ec3-6986-487c-bb9e-76e54343d380","Type":"ContainerStarted","Data":"a1f1a624e17875e16f4c6702f6557f7b4ead25fac7e4b8f3e6b2be213c3bd94c"}
Oct 31 13:05:39.567830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.567808    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:39.567919 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.567861    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:39.568929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.568909    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf"
Oct 31 13:05:39.611675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.611592    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" podStartSLOduration=1.820407117 podStartE2EDuration="7.611574424s" totalImagesPullingTime="5.791167307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:39.60823669 +0000 UTC m=+361.271662373" watchObservedRunningTime="2026-10-31 13:05:39.611574424 +0000 UTC m=+361.275000193"
Oct 31 13:05:39.639864 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.639814    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:39.658488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:39.658423    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq" podStartSLOduration=1.98333377 podStartE2EDuration="4.658403698s" totalImagesPullingTime="2.675069928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:39.657163334 +0000 UTC m=+361.320589021" watchObservedRunningTime="2026-10-31 13:05:39.658403698 +0000 UTC m=+361.321829389"
Oct 31 13:05:40.778586 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:40.778562    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 31 13:05:41.009367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.009331    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:41.563726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.563690    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:41.582707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.582670    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v" event={"ID":"db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7","Type":"ContainerStarted","Data":"5077031f9cfe502cda9d8897c0cfadbb11d740dd619812730b47be5a5446ff42"}
Oct 31 13:05:41.614989 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.614935    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-776d875d45-zhg8v" podStartSLOduration=1.8968254070000001 podStartE2EDuration="4.614920031s" totalImagesPullingTime="2.718094624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:41.613316487 +0000 UTC m=+363.276742192" watchObservedRunningTime="2026-10-31 13:05:41.614920031 +0000 UTC m=+363.278345716"
Oct 31 13:05:41.777735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.777671    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:41.923556 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:41.923474    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:43.479905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:43.479870    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:46.155099 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:46.155062    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:46.317590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:46.317555    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:47.861623 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:47.861550    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:48.006769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:48.006732    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:48.235752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:48.235708    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:48.368957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:48.368923    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:48.621320 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:48.621230    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:48.784732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:48.784697    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:50.576053 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:50.576016    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-vwpqq"
Oct 31 13:05:50.576446 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:50.576338    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:05:50.983130 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:50.983090    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:05:50.986576 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:50.986556    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.007284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.007248    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:05:51.036485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.036450    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.036694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.036497    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqv5\" (UniqueName: \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.137389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.137347    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqv5\" (UniqueName: \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.137574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.137473    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.137924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.137904    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.157355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.157314    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqv5\" (UniqueName: \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\") pod \"kuadrant-operator-controller-manager-678d87766f-c52mr\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.299250 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.299144    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:51.594259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.594232    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:05:51.594869 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:05:51.594842    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83429353_c71a_4c25_9dac_3386c0f673a5.slice/crio-273c64e4aac42f9135723557a83c55308d3576648d461dc0dfcce677e07c65a5 WatchSource:0}: Error finding container 273c64e4aac42f9135723557a83c55308d3576648d461dc0dfcce677e07c65a5: Status 404 returned error can't find the container with id 273c64e4aac42f9135723557a83c55308d3576648d461dc0dfcce677e07c65a5
Oct 31 13:05:51.634791 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:51.634754    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" event={"ID":"83429353-c71a-4c25-9dac-3386c0f673a5","Type":"ContainerStarted","Data":"273c64e4aac42f9135723557a83c55308d3576648d461dc0dfcce677e07c65a5"}
Oct 31 13:05:52.641441 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:52.641396    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" event={"ID":"83429353-c71a-4c25-9dac-3386c0f673a5","Type":"ContainerStarted","Data":"2d6cce31e71fcf8c46121c332795402803bcef6e1975445c74b83b2ad7834f46"}
Oct 31 13:05:52.641960 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:52.641487    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:05:52.669753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:52.669695    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" podStartSLOduration=2.669676899 podStartE2EDuration="2.669676899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:05:52.666755651 +0000 UTC m=+374.330181347" watchObservedRunningTime="2026-10-31 13:05:52.669676899 +0000 UTC m=+374.333102584"
Oct 31 13:05:54.330090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:54.330039    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:54.467638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:05:54.467576    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:05:59.573074 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:05:59.573032    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:06:00.848957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:00.848907    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:01.035894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:01.035860    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:03.650211 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:03.650176    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:06:03.748177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:03.748144    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:06:03.748463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:03.748427    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" podUID="84e232fc-649a-41dd-9f30-28a459256cc6" containerName="manager" containerID="cri-o://45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326" gracePeriod=10
Oct 31 13:06:03.886710 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:03.886677    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:04.002010 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.001983    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:06:04.028699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.028661    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:04.047779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.047751    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\" (UniqueName: \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\") pod \"84e232fc-649a-41dd-9f30-28a459256cc6\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") "
Oct 31 13:06:04.047946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.047840    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\") pod \"84e232fc-649a-41dd-9f30-28a459256cc6\" (UID: \"84e232fc-649a-41dd-9f30-28a459256cc6\") "
Oct 31 13:06:04.048375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.048351    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume" pod "84e232fc-649a-41dd-9f30-28a459256cc6" (UID: "84e232fc-649a-41dd-9f30-28a459256cc6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:06:04.050069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.050044    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9" pod "84e232fc-649a-41dd-9f30-28a459256cc6" (UID: "84e232fc-649a-41dd-9f30-28a459256cc6"). InnerVolumeSpecName "kube-api-access-5g9p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:06:04.149096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.149056    4958 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84e232fc-649a-41dd-9f30-28a459256cc6-extensions-socket-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:06:04.149096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.149087    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g9p9\" (UniqueName: \"kubernetes.io/projected/84e232fc-649a-41dd-9f30-28a459256cc6-kube-api-access-5g9p9\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:06:04.714395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.714354    4958 generic.go:356] "Generic (PLEG): container finished" podID="84e232fc-649a-41dd-9f30-28a459256cc6" containerID="45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326" exitCode=0
Oct 31 13:06:04.714886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.714401    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"
Oct 31 13:06:04.714886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.714438    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" event={"ID":"84e232fc-649a-41dd-9f30-28a459256cc6","Type":"ContainerDied","Data":"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"}
Oct 31 13:06:04.714886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.714495    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t" event={"ID":"84e232fc-649a-41dd-9f30-28a459256cc6","Type":"ContainerDied","Data":"bfc0561d9abaa65baaa4db7a1d2104f7dbcdccf7b7c36cee069244527318c9e8"}
Oct 31 13:06:04.714886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.714525    4958 scope.go:122] "RemoveContainer" containerID="45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"
Oct 31 13:06:04.724121 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.724102    4958 scope.go:122] "RemoveContainer" containerID="45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"
Oct 31 13:06:04.724405 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:06:04.724385    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326\": container with ID starting with 45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326 not found: ID does not exist" containerID="45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"
Oct 31 13:06:04.724460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.724415    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326"} err="failed to get container status \"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326\": rpc error: code = NotFound desc = could not find container \"45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326\": container with ID starting with 45e1173e38dcb5ced3c02a32c34027c8eb28cac4b64b75acecb1f7248fb4b326 not found: ID does not exist"
Oct 31 13:06:04.740910 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.740880    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:06:04.743210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:04.743187    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-4vz9t"]
Oct 31 13:06:05.873249 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:05.873214    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:06.014196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:06.014162    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:06.489484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:06.489446    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84e232fc-649a-41dd-9f30-28a459256cc6" path="/var/lib/kubelet/pods/84e232fc-649a-41dd-9f30-28a459256cc6/volumes"
Oct 31 13:06:09.066371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:09.066330    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:09.216680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:09.216596    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:09.441942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:09.441860    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:09.582279 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:09.582242    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:09.714637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:09.714574    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:16.791911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:16.791869    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:16.968696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:16.968658    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:22.552802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:22.552723    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:22.696844 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:22.696808    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:25.460123 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.460086    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:25.610421 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.610386    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:25.614716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.614685    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:25.615071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.615059    4958 cpu_manager.go:414] "containerMap: removing container" podUID="84e232fc-649a-41dd-9f30-28a459256cc6" containerName="manager"
Oct 31 13:06:25.615163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.615073    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84e232fc-649a-41dd-9f30-28a459256cc6" containerName="manager"
Oct 31 13:06:25.615163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.615143    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="84e232fc-649a-41dd-9f30-28a459256cc6" containerName="manager"
Oct 31 13:06:25.617136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.617120    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.628675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.628651    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 13:06:25.629460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.629442    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9kb5b\""
Oct 31 13:06:25.643855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.643823    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:25.698801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.698767    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:25.742076 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.741985    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwmg\" (UniqueName: \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.742076 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.742070    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.780494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.780456    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:25.843595 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.843554    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.843804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.843641    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwmg\" (UniqueName: \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.844266 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.844243    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.858347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.858309    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwmg\" (UniqueName: \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\") pod \"limitador-limitador-74dfcfb894-zk4kn\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:25.917337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.917302    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:25.929333 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:25.929295    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:26.210073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.210041    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:26.214069 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:06:26.214036    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77885087_3c57_492b_9192_320287e58b30.slice/crio-903831866e10cbbc625aa062150b01bcf27f5d7b3e151cdf9bc9d2954908132b WatchSource:0}: Error finding container 903831866e10cbbc625aa062150b01bcf27f5d7b3e151cdf9bc9d2954908132b: Status 404 returned error can't find the container with id 903831866e10cbbc625aa062150b01bcf27f5d7b3e151cdf9bc9d2954908132b
Oct 31 13:06:26.448985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.448945    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:26.451906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.451877    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:26.460418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.460353    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ddb8z\""
Oct 31 13:06:26.460808 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.460492    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:26.543258 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.543214    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:26.549395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.549359    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvf8\" (UniqueName: \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\") pod \"authorino-57f7f8659f-wb7xr\" (UID: \"1c19c747-7634-4880-9be7-de86b17951b4\") " pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:26.650744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.650704    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvf8\" (UniqueName: \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\") pod \"authorino-57f7f8659f-wb7xr\" (UID: \"1c19c747-7634-4880-9be7-de86b17951b4\") " pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:26.664522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.664495    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvf8\" (UniqueName: \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\") pod \"authorino-57f7f8659f-wb7xr\" (UID: \"1c19c747-7634-4880-9be7-de86b17951b4\") " pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:26.751071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.750983    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:26.769487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.769456    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:26.833105 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:26.833072    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" event={"ID":"77885087-3c57-492b-9192-320287e58b30","Type":"ContainerStarted","Data":"903831866e10cbbc625aa062150b01bcf27f5d7b3e151cdf9bc9d2954908132b"}
Oct 31 13:06:27.049098 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:27.049065    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:27.050528 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:06:27.050494    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c19c747_7634_4880_9be7_de86b17951b4.slice/crio-0efb841c7a13b474f78d82ad669528def769748e4df9063e1cd62cbbd16e0c9f WatchSource:0}: Error finding container 0efb841c7a13b474f78d82ad669528def769748e4df9063e1cd62cbbd16e0c9f: Status 404 returned error can't find the container with id 0efb841c7a13b474f78d82ad669528def769748e4df9063e1cd62cbbd16e0c9f
Oct 31 13:06:27.839946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:27.839895    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" event={"ID":"1c19c747-7634-4880-9be7-de86b17951b4","Type":"ContainerStarted","Data":"0efb841c7a13b474f78d82ad669528def769748e4df9063e1cd62cbbd16e0c9f"}
Oct 31 13:06:27.841491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:27.841461    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" event={"ID":"77885087-3c57-492b-9192-320287e58b30","Type":"ContainerStarted","Data":"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"}
Oct 31 13:06:27.841661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:27.841625    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:27.865285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:27.865234    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" podStartSLOduration=1.402694201 podStartE2EDuration="2.865221418s" totalImagesPullingTime="1.462527217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:06:27.863310359 +0000 UTC m=+409.526736068" watchObservedRunningTime="2026-10-31 13:06:27.865221418 +0000 UTC m=+409.528647102"
Oct 31 13:06:28.716482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:28.716447    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:29.573410 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:06:29.573324    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:06:29.853533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:29.853439    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" event={"ID":"1c19c747-7634-4880-9be7-de86b17951b4","Type":"ContainerStarted","Data":"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"}
Oct 31 13:06:30.312033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:30.311974    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" podStartSLOduration=2.084384485 podStartE2EDuration="4.311958777s" totalImagesPullingTime="2.227574292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:06:29.879551004 +0000 UTC m=+411.542976700" watchObservedRunningTime="2026-10-31 13:06:30.311958777 +0000 UTC m=+411.975384461"
Oct 31 13:06:30.312214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:30.312093    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:31.863281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:31.863237    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" podUID="1c19c747-7634-4880-9be7-de86b17951b4" containerName="authorino" containerID="cri-o://18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54" gracePeriod=30
Oct 31 13:06:32.100552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.100524    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:32.202348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.202249    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\" (UniqueName: \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\") pod \"1c19c747-7634-4880-9be7-de86b17951b4\" (UID: \"1c19c747-7634-4880-9be7-de86b17951b4\") "
Oct 31 13:06:32.204366 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.204336    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8" pod "1c19c747-7634-4880-9be7-de86b17951b4" (UID: "1c19c747-7634-4880-9be7-de86b17951b4"). InnerVolumeSpecName "kube-api-access-7pvf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:06:32.303090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.303044    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvf8\" (UniqueName: \"kubernetes.io/projected/1c19c747-7634-4880-9be7-de86b17951b4-kube-api-access-7pvf8\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:06:32.870669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.870575    4958 generic.go:356] "Generic (PLEG): container finished" podID="1c19c747-7634-4880-9be7-de86b17951b4" containerID="18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54" exitCode=0
Oct 31 13:06:32.870669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.870635    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wb7xr"
Oct 31 13:06:32.871125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.870669    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" event={"ID":"1c19c747-7634-4880-9be7-de86b17951b4","Type":"ContainerDied","Data":"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"}
Oct 31 13:06:32.871125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.870716    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wb7xr" event={"ID":"1c19c747-7634-4880-9be7-de86b17951b4","Type":"ContainerDied","Data":"0efb841c7a13b474f78d82ad669528def769748e4df9063e1cd62cbbd16e0c9f"}
Oct 31 13:06:32.871125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.870737    4958 scope.go:122] "RemoveContainer" containerID="18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"
Oct 31 13:06:32.880125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.880103    4958 scope.go:122] "RemoveContainer" containerID="18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"
Oct 31 13:06:32.880465 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:06:32.880423    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54\": container with ID starting with 18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54 not found: ID does not exist" containerID="18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"
Oct 31 13:06:32.880516 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.880475    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54"} err="failed to get container status \"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54\": rpc error: code = NotFound desc = could not find container \"18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54\": container with ID starting with 18a28e8851fa910e9b544a86c6dcc3e4ebd9c96ee022d4705b39891e778fbd54 not found: ID does not exist"
Oct 31 13:06:32.892184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.892147    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:32.898521 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:32.898484    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wb7xr"]
Oct 31 13:06:34.489631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:34.489572    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c19c747-7634-4880-9be7-de86b17951b4" path="/var/lib/kubelet/pods/1c19c747-7634-4880-9be7-de86b17951b4/volumes"
Oct 31 13:06:35.036437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.036378    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:35.192454 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.192418    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-zf6qv"]
Oct 31 13:06:35.192843 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.192827    4958 cpu_manager.go:414] "containerMap: removing container" podUID="1c19c747-7634-4880-9be7-de86b17951b4" containerName="authorino"
Oct 31 13:06:35.192900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.192847    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c19c747-7634-4880-9be7-de86b17951b4" containerName="authorino"
Oct 31 13:06:35.192959 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.192947    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c19c747-7634-4880-9be7-de86b17951b4" containerName="authorino"
Oct 31 13:06:35.197438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.197415    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.210042 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.210015    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zf6qv"]
Oct 31 13:06:35.216227 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.216204    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 31 13:06:35.216588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.216569    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 31 13:06:35.216985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.216960    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:35.234030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.234007    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 31 13:06:35.234187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.234169    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c9tfg\""
Oct 31 13:06:35.234264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.234231    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 31 13:06:35.239664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.239647    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-metrics-certs\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.239723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.239689    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-cert\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.239807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.239790    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jc8\" (UniqueName: \"kubernetes.io/projected/b52cbb41-fdb5-4f53-95b7-da66829b302f-kube-api-access-n2jc8\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.341097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.340998    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-metrics-certs\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.341097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.341055    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-cert\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.341097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.341102    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jc8\" (UniqueName: \"kubernetes.io/projected/b52cbb41-fdb5-4f53-95b7-da66829b302f-kube-api-access-n2jc8\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.343678 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.343651    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-metrics-certs\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.343794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.343767    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b52cbb41-fdb5-4f53-95b7-da66829b302f-cert\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.355429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.355401    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jc8\" (UniqueName: \"kubernetes.io/projected/b52cbb41-fdb5-4f53-95b7-da66829b302f-kube-api-access-n2jc8\") pod \"odh-model-controller-769875db56-zf6qv\" (UID: \"b52cbb41-fdb5-4f53-95b7-da66829b302f\") " pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.497733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.497685    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:35.511733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.511693    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:35.669529 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.669430    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:35.792236 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.792210    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zf6qv"]
Oct 31 13:06:35.794317 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:06:35.794288    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52cbb41_fdb5_4f53_95b7_da66829b302f.slice/crio-a6053fe892ceb9b11bd730d4801f095701873af84ea962fb300bd066593e5a42 WatchSource:0}: Error finding container a6053fe892ceb9b11bd730d4801f095701873af84ea962fb300bd066593e5a42: Status 404 returned error can't find the container with id a6053fe892ceb9b11bd730d4801f095701873af84ea962fb300bd066593e5a42
Oct 31 13:06:35.889126 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:35.889087    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zf6qv" event={"ID":"b52cbb41-fdb5-4f53-95b7-da66829b302f","Type":"ContainerStarted","Data":"a6053fe892ceb9b11bd730d4801f095701873af84ea962fb300bd066593e5a42"}
Oct 31 13:06:37.139190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:37.139103    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:37.343029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:37.342960    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:38.848504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:38.848418    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:38.910756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:38.910717    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zf6qv" event={"ID":"b52cbb41-fdb5-4f53-95b7-da66829b302f","Type":"ContainerStarted","Data":"c9812a6bccb3216a47cde133203a74e22fcd91b81f99bb26ba1e2282726748e2"}
Oct 31 13:06:38.910947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:38.910793    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:38.942851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:38.942769    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-zf6qv" podStartSLOduration=1.250353613 podStartE2EDuration="3.942742247s" totalImagesPullingTime="2.692388634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:06:38.942438815 +0000 UTC m=+420.605864529" watchObservedRunningTime="2026-10-31 13:06:38.942742247 +0000 UTC m=+420.606167933"
Oct 31 13:06:39.838432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:39.838394    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:39.838672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:39.838595    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" podUID="77885087-3c57-492b-9192-320287e58b30" containerName="limitador" containerID="cri-o://e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d" gracePeriod=30
Oct 31 13:06:40.389191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.389167    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:40.483050 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.482993    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\" (UniqueName: \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\") pod \"77885087-3c57-492b-9192-320287e58b30\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") "
Oct 31 13:06:40.483361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.483146    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\" (UniqueName: \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\") pod \"77885087-3c57-492b-9192-320287e58b30\" (UID: \"77885087-3c57-492b-9192-320287e58b30\") "
Oct 31 13:06:40.484677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.484638    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file" pod "77885087-3c57-492b-9192-320287e58b30" (UID: "77885087-3c57-492b-9192-320287e58b30"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:06:40.492986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.492950    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg" pod "77885087-3c57-492b-9192-320287e58b30" (UID: "77885087-3c57-492b-9192-320287e58b30"). InnerVolumeSpecName "kube-api-access-qqwmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:06:40.584466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.584425    4958 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77885087-3c57-492b-9192-320287e58b30-config-file\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:06:40.584466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.584462    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqwmg\" (UniqueName: \"kubernetes.io/projected/77885087-3c57-492b-9192-320287e58b30-kube-api-access-qqwmg\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:06:40.923326 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.923235    4958 generic.go:356] "Generic (PLEG): container finished" podID="77885087-3c57-492b-9192-320287e58b30" containerID="e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d" exitCode=0
Oct 31 13:06:40.923326 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.923305    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"
Oct 31 13:06:40.923326 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.923312    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" event={"ID":"77885087-3c57-492b-9192-320287e58b30","Type":"ContainerDied","Data":"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"}
Oct 31 13:06:40.923684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.923372    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-zk4kn" event={"ID":"77885087-3c57-492b-9192-320287e58b30","Type":"ContainerDied","Data":"903831866e10cbbc625aa062150b01bcf27f5d7b3e151cdf9bc9d2954908132b"}
Oct 31 13:06:40.923684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.923396    4958 scope.go:122] "RemoveContainer" containerID="e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"
Oct 31 13:06:40.933642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.933593    4958 scope.go:122] "RemoveContainer" containerID="e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"
Oct 31 13:06:40.933952 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:06:40.933931    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d\": container with ID starting with e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d not found: ID does not exist" containerID="e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"
Oct 31 13:06:40.934029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.933967    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d"} err="failed to get container status \"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d\": rpc error: code = NotFound desc = could not find container \"e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d\": container with ID starting with e6a55e8553c80351c9631ca6111f96b8baca0e392a26e5ca9b16add66c6fea1d not found: ID does not exist"
Oct 31 13:06:40.949434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.949408    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:40.951562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:40.951537    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-zk4kn"]
Oct 31 13:06:42.489909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:42.489867    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77885087-3c57-492b-9192-320287e58b30" path="/var/lib/kubelet/pods/77885087-3c57-492b-9192-320287e58b30/volumes"
Oct 31 13:06:46.213551 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.213496    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:46.362498 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.362459    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:46.886996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.886955    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"]
Oct 31 13:06:46.887451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.887430    4958 cpu_manager.go:414] "containerMap: removing container" podUID="77885087-3c57-492b-9192-320287e58b30" containerName="limitador"
Oct 31 13:06:46.887554 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.887453    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77885087-3c57-492b-9192-320287e58b30" containerName="limitador"
Oct 31 13:06:46.887554 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.887541    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="77885087-3c57-492b-9192-320287e58b30" containerName="limitador"
Oct 31 13:06:46.892030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.892004    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:46.897546 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.897516    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 13:06:46.910746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.910718    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"]
Oct 31 13:06:46.915360 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.915332    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 31 13:06:46.915568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.915550    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-d6p4x\""
Oct 31 13:06:46.941341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.941304    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/61d26d7c-4459-4c21-b845-df77b2980f1d-data\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:46.941509 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.941369    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kglg\" (UniqueName: \"kubernetes.io/projected/61d26d7c-4459-4c21-b845-df77b2980f1d-kube-api-access-7kglg\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:46.997528 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:46.997494    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 13:06:47.021557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.021520    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:06:47.042490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.042453    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/61d26d7c-4459-4c21-b845-df77b2980f1d-data\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:47.042694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.042532    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kglg\" (UniqueName: \"kubernetes.io/projected/61d26d7c-4459-4c21-b845-df77b2980f1d-kube-api-access-7kglg\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:47.042873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.042852    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/61d26d7c-4459-4c21-b845-df77b2980f1d-data\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:47.056008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.055983    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kglg\" (UniqueName: \"kubernetes.io/projected/61d26d7c-4459-4c21-b845-df77b2980f1d-kube-api-access-7kglg\") pod \"postgres-7cdbf6dc44-sffcv\" (UID: \"61d26d7c-4459-4c21-b845-df77b2980f1d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:47.206282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.206181    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:47.491724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.491686    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"]
Oct 31 13:06:47.496452 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:06:47.496417    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d26d7c_4459_4c21_b845_df77b2980f1d.slice/crio-6a447360c2204289db8911b4077fde7a7ac08f265dc2b9e01ffd3db3070b05ae WatchSource:0}: Error finding container 6a447360c2204289db8911b4077fde7a7ac08f265dc2b9e01ffd3db3070b05ae: Status 404 returned error can't find the container with id 6a447360c2204289db8911b4077fde7a7ac08f265dc2b9e01ffd3db3070b05ae
Oct 31 13:06:47.963347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:47.963315    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv" event={"ID":"61d26d7c-4459-4c21-b845-df77b2980f1d","Type":"ContainerStarted","Data":"6a447360c2204289db8911b4077fde7a7ac08f265dc2b9e01ffd3db3070b05ae"}
Oct 31 13:06:49.918203 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:49.918170    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-zf6qv"
Oct 31 13:06:55.006309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:55.006270    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv" event={"ID":"61d26d7c-4459-4c21-b845-df77b2980f1d","Type":"ContainerStarted","Data":"1aa273acabcc81a06a6b13009a7311753b90e2db28b2de7dfeaf1988e5ee3a63"}
Oct 31 13:06:55.006739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:55.006337    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:06:55.028220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:06:55.028166    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv" podStartSLOduration=1.934840787 podStartE2EDuration="9.028152007s" totalImagesPullingTime="7.09331122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:06:55.026047141 +0000 UTC m=+436.689472825" watchObservedRunningTime="2026-10-31 13:06:55.028152007 +0000 UTC m=+436.691577691"
Oct 31 13:06:59.574744 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:06:59.574699    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:07:01.041565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:01.041534    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-sffcv"
Oct 31 13:07:08.122313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.122250    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:08.172175 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.172136    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:08.177098 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.177076    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.185411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.185384    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 13:07:08.186083 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.186057    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sj2wv\""
Oct 31 13:07:08.186195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.186058    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 13:07:08.186195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.186127    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 13:07:08.187653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.187630    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:08.266856 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.266819    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:08.338832 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.338772    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.339048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.338954    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.339048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.338997    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vhz\" (UniqueName: \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.406650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.406530    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:08.439744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.439697    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.439912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.439769    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vhz\" (UniqueName: \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.439912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.439826    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.442484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.442446    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.442626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.442446    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.453295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.453270    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vhz\" (UniqueName: \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\") pod \"maas-controller-579cf7c6d-klcxb\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") " pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.491797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.491767    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:08.513935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.513902    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:07:08.519028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.518999    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.530812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.530783    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:07:08.542152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.542090    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:08.641990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.641951    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknv4\" (UniqueName: \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.642170 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.641999    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.642224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.642192    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.743676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.743641    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.743859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.743692    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknv4\" (UniqueName: \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.743859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.743737    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.746269 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.746240    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.746269 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.746263    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.757872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.757846    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknv4\" (UniqueName: \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\") pod \"maas-controller-bd9ffcfc7-bzllh\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") " pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:08.778129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.778098    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:08.779499 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:07:08.779473    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2091e7_06df_4790_bebe_80522139cbb3.slice/crio-645e0157ba46096c2e490522ddcd818f68b3c1f7c8ce06691735cda13a43832f WatchSource:0}: Error finding container 645e0157ba46096c2e490522ddcd818f68b3c1f7c8ce06691735cda13a43832f: Status 404 returned error can't find the container with id 645e0157ba46096c2e490522ddcd818f68b3c1f7c8ce06691735cda13a43832f
Oct 31 13:07:08.835305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:08.835266    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:09.077012 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:09.076929    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-klcxb" event={"ID":"fd2091e7-06df-4790-bebe-80522139cbb3","Type":"ContainerStarted","Data":"645e0157ba46096c2e490522ddcd818f68b3c1f7c8ce06691735cda13a43832f"}
Oct 31 13:07:09.115433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:09.115405    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:07:09.117144 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:07:09.117118    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c852253_471e_4b21_87aa_22aa4ff8c454.slice/crio-c223e83a66f822aeebcfcaecaff71bc13f191434c40c9dc8a1b103b8dd677959 WatchSource:0}: Error finding container c223e83a66f822aeebcfcaecaff71bc13f191434c40c9dc8a1b103b8dd677959: Status 404 returned error can't find the container with id c223e83a66f822aeebcfcaecaff71bc13f191434c40c9dc8a1b103b8dd677959
Oct 31 13:07:10.085891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:10.085840    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" event={"ID":"7c852253-471e-4b21-87aa-22aa4ff8c454","Type":"ContainerStarted","Data":"c223e83a66f822aeebcfcaecaff71bc13f191434c40c9dc8a1b103b8dd677959"}
Oct 31 13:07:12.513733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:12.513688    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:12.669807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:12.669727    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:13.115127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.115087    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" event={"ID":"7c852253-471e-4b21-87aa-22aa4ff8c454","Type":"ContainerStarted","Data":"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"}
Oct 31 13:07:13.115338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.115190    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:13.116643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.116616    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-klcxb" event={"ID":"fd2091e7-06df-4790-bebe-80522139cbb3","Type":"ContainerStarted","Data":"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"}
Oct 31 13:07:13.116775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.116676    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:13.142513 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.142455    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" podStartSLOduration=1.984790499 podStartE2EDuration="5.142441896s" totalImagesPullingTime="3.157651397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:07:13.141312041 +0000 UTC m=+454.804737727" watchObservedRunningTime="2026-10-31 13:07:13.142441896 +0000 UTC m=+454.805867581"
Oct 31 13:07:13.164879 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:13.164833    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-klcxb" podStartSLOduration=1.60691205 podStartE2EDuration="5.164819502s" totalImagesPullingTime="3.557907452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:07:13.163853293 +0000 UTC m=+454.827278977" watchObservedRunningTime="2026-10-31 13:07:13.164819502 +0000 UTC m=+454.828245188"
Oct 31 13:07:14.057056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.057020    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"]
Oct 31 13:07:14.061033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.061010    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.070885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.070858    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 31 13:07:14.071028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.070929    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 31 13:07:14.073636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.071689    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 31 13:07:14.076818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.075109    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"]
Oct 31 13:07:14.076818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.075289    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-fjbb4\""
Oct 31 13:07:14.156683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.156645    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:14.199765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.199728    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.199948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.199778    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.199948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.199862    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpl9g\" (UniqueName: \"kubernetes.io/projected/346a7c42-c6fa-4412-9954-70b692784be6-kube-api-access-kpl9g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.199948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.199916    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/346a7c42-c6fa-4412-9954-70b692784be6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.300851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.300814    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.300851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.300856    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpl9g\" (UniqueName: \"kubernetes.io/projected/346a7c42-c6fa-4412-9954-70b692784be6-kube-api-access-kpl9g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.301136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.300926    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/346a7c42-c6fa-4412-9954-70b692784be6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.301136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.301061    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.301716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.301688    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.301978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.301962    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/346a7c42-c6fa-4412-9954-70b692784be6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.303668 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.303641    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/346a7c42-c6fa-4412-9954-70b692784be6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.315328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.315256    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpl9g\" (UniqueName: \"kubernetes.io/projected/346a7c42-c6fa-4412-9954-70b692784be6-kube-api-access-kpl9g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-79vlx\" (UID: \"346a7c42-c6fa-4412-9954-70b692784be6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.326264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.326216    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:14.379011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.378969    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:14.662813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:14.662781    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"]
Oct 31 13:07:14.665011 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:07:14.664982    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346a7c42_c6fa_4412_9954_70b692784be6.slice/crio-6104f127759a50dde60820a2806284c3be370425e0dd39e4769f4dffa8a26356 WatchSource:0}: Error finding container 6104f127759a50dde60820a2806284c3be370425e0dd39e4769f4dffa8a26356: Status 404 returned error can't find the container with id 6104f127759a50dde60820a2806284c3be370425e0dd39e4769f4dffa8a26356
Oct 31 13:07:15.130122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:15.130086    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx" event={"ID":"346a7c42-c6fa-4412-9954-70b692784be6","Type":"ContainerStarted","Data":"6104f127759a50dde60820a2806284c3be370425e0dd39e4769f4dffa8a26356"}
Oct 31 13:07:24.127547 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.127508    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:24.128005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.127745    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:07:24.208336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.208297    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:24.208536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.208497    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-klcxb" podUID="fd2091e7-06df-4790-bebe-80522139cbb3" containerName="manager" containerID="cri-o://f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c" gracePeriod=30
Oct 31 13:07:24.490208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.490177    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:24.493128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.493095    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\") pod \"fd2091e7-06df-4790-bebe-80522139cbb3\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") "
Oct 31 13:07:24.493274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.493168    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\") pod \"fd2091e7-06df-4790-bebe-80522139cbb3\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") "
Oct 31 13:07:24.493274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.493237    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\" (UniqueName: \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\") pod \"fd2091e7-06df-4790-bebe-80522139cbb3\" (UID: \"fd2091e7-06df-4790-bebe-80522139cbb3\") "
Oct 31 13:07:24.496583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.496556    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert" pod "fd2091e7-06df-4790-bebe-80522139cbb3" (UID: "fd2091e7-06df-4790-bebe-80522139cbb3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:07:24.496732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.496708    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs" pod "fd2091e7-06df-4790-bebe-80522139cbb3" (UID: "fd2091e7-06df-4790-bebe-80522139cbb3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:07:24.497179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.497148    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz" pod "fd2091e7-06df-4790-bebe-80522139cbb3" (UID: "fd2091e7-06df-4790-bebe-80522139cbb3"). InnerVolumeSpecName "kube-api-access-f9vhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:07:24.594359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.594319    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9vhz\" (UniqueName: \"kubernetes.io/projected/fd2091e7-06df-4790-bebe-80522139cbb3-kube-api-access-f9vhz\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:24.594359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.594361    4958 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-webhook-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:24.594640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:24.594376    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd2091e7-06df-4790-bebe-80522139cbb3-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:25.202332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.202291    4958 generic.go:356] "Generic (PLEG): container finished" podID="fd2091e7-06df-4790-bebe-80522139cbb3" containerID="f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c" exitCode=0
Oct 31 13:07:25.202829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.202352    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-klcxb"
Oct 31 13:07:25.202829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.202387    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-klcxb" event={"ID":"fd2091e7-06df-4790-bebe-80522139cbb3","Type":"ContainerDied","Data":"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"}
Oct 31 13:07:25.202829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.202459    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-klcxb" event={"ID":"fd2091e7-06df-4790-bebe-80522139cbb3","Type":"ContainerDied","Data":"645e0157ba46096c2e490522ddcd818f68b3c1f7c8ce06691735cda13a43832f"}
Oct 31 13:07:25.202829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.202490    4958 scope.go:122] "RemoveContainer" containerID="f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"
Oct 31 13:07:25.214479 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.214347    4958 scope.go:122] "RemoveContainer" containerID="f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"
Oct 31 13:07:25.214713 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:07:25.214691    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c\": container with ID starting with f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c not found: ID does not exist" containerID="f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"
Oct 31 13:07:25.214790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.214727    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c"} err="failed to get container status \"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c\": rpc error: code = NotFound desc = could not find container \"f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c\": container with ID starting with f6eef49081d72503ecbcae2e23ff1ff348b1d244e865a6a53cc34c0551b2bd0c not found: ID does not exist"
Oct 31 13:07:25.230834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.230807    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:25.235067 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:25.235045    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-klcxb"]
Oct 31 13:07:26.492723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:26.492677    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd2091e7-06df-4790-bebe-80522139cbb3" path="/var/lib/kubelet/pods/fd2091e7-06df-4790-bebe-80522139cbb3/volumes"
Oct 31 13:07:28.228311 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:28.228271    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx" event={"ID":"346a7c42-c6fa-4412-9954-70b692784be6","Type":"ContainerStarted","Data":"146f4be6312bb4be4a159d086e5992a1115ff05a872c2ba10e667b01b868562c"}
Oct 31 13:07:28.228722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:28.228353    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:28.252121 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:28.252070    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx" podStartSLOduration=1.309801385 podStartE2EDuration="14.252057774s" totalImagesPullingTime="12.942256389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:07:28.249154932 +0000 UTC m=+469.912580614" watchObservedRunningTime="2026-10-31 13:07:28.252057774 +0000 UTC m=+469.915483458"
Oct 31 13:07:28.761696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:28.761666    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:29.573546 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:07:29.573506    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:07:37.599453 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:37.599418    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:37.736538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:37.736504    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:39.239835 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:39.239798    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-79vlx"
Oct 31 13:07:44.401213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:44.401177    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:44.548636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:44.548578    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:45.782438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.782402    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:45.872772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.872736    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:07:45.873352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.873320    4958 cpu_manager.go:414] "containerMap: removing container" podUID="fd2091e7-06df-4790-bebe-80522139cbb3" containerName="manager"
Oct 31 13:07:45.873352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.873347    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd2091e7-06df-4790-bebe-80522139cbb3" containerName="manager"
Oct 31 13:07:45.873599 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.873484    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd2091e7-06df-4790-bebe-80522139cbb3" containerName="manager"
Oct 31 13:07:45.896018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.895985    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:07:45.896175 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.896040    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:45.912494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.912453    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2hbvg\""
Oct 31 13:07:45.912705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.912522    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 13:07:45.912705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.912595    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 13:07:45.938469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.938432    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:45.982751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.982709    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfs7\" (UniqueName: \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:45.982949 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.982766    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:45.982949 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.982875    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:45.983035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:45.982944    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.083985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.083878    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfs7\" (UniqueName: \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.083985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.083938    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.083985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.083976    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.084306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.084004    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.084802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.084775    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.086502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.086473    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.086650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.086553    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.091473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.091442    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:46.097981 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.097951    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfs7\" (UniqueName: \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\") pod \"maas-api-6d669c7fcd-nprxq\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.209214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.209179    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:46.496591 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:46.496565    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:07:46.498547 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:07:46.498517    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8941db28_5d20_4c49_a48e_18ca4864f52c.slice/crio-0d88ad55d9198c53d013d071e73695206b0c5d56c9c62acb80d1a7e2b1bf4f30 WatchSource:0}: Error finding container 0d88ad55d9198c53d013d071e73695206b0c5d56c9c62acb80d1a7e2b1bf4f30: Status 404 returned error can't find the container with id 0d88ad55d9198c53d013d071e73695206b0c5d56c9c62acb80d1a7e2b1bf4f30
Oct 31 13:07:47.329840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:47.329799    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" event={"ID":"8941db28-5d20-4c49-a48e-18ca4864f52c","Type":"ContainerStarted","Data":"0d88ad55d9198c53d013d071e73695206b0c5d56c9c62acb80d1a7e2b1bf4f30"}
Oct 31 13:07:49.355087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:49.355043    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" event={"ID":"8941db28-5d20-4c49-a48e-18ca4864f52c","Type":"ContainerStarted","Data":"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"}
Oct 31 13:07:49.355534 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:49.355122    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:49.379733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:49.379677    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" podStartSLOduration=2.462775568 podStartE2EDuration="4.379663065s" totalImagesPullingTime="1.916887497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:07:49.376872087 +0000 UTC m=+491.040297792" watchObservedRunningTime="2026-10-31 13:07:49.379663065 +0000 UTC m=+491.043088749"
Oct 31 13:07:55.367114 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:55.367082    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:07:55.884341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:55.884290    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:56.071809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.071775    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:07:56.241715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.241678    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-rww67"]
Oct 31 13:07:56.245435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.245413    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.254644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.254620    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ddb8z\""
Oct 31 13:07:56.256632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.256594    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-rww67"]
Oct 31 13:07:56.330638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.330593    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-rww67"]
Oct 31 13:07:56.339164 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:07:56.330816    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tf9pl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-rww67" podUID="8a6c5656-0dfc-4643-9b6c-a7ece446e398"
Oct 31 13:07:56.374465 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.374429    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-t62k5"]
Oct 31 13:07:56.377796 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.377779    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.383810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.383763    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 13:07:56.389837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.389815    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-t62k5"]
Oct 31 13:07:56.394963 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.394941    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.398855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.398831    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9pl\" (UniqueName: \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\") pod \"authorino-6f6944bcdd-rww67\" (UID: \"8a6c5656-0dfc-4643-9b6c-a7ece446e398\") " pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.401745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.401722    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.499752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.499667    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.499752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.499712    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9pl\" (UniqueName: \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\") pod \"authorino-6f6944bcdd-rww67\" (UID: \"8a6c5656-0dfc-4643-9b6c-a7ece446e398\") " pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.499752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.499738    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjn5\" (UniqueName: \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.520064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.520032    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9pl\" (UniqueName: \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\") pod \"authorino-6f6944bcdd-rww67\" (UID: \"8a6c5656-0dfc-4643-9b6c-a7ece446e398\") " pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:56.598774 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.598668    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-t62k5"]
Oct 31 13:07:56.598952 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:07:56.598931    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5cjn5 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-t62k5" podUID="ac680868-b0b7-40c0-b4e2-52335344fcb5"
Oct 31 13:07:56.600442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.600419    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\" (UniqueName: \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\") pod \"8a6c5656-0dfc-4643-9b6c-a7ece446e398\" (UID: \"8a6c5656-0dfc-4643-9b6c-a7ece446e398\") "
Oct 31 13:07:56.600585 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.600571    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.600658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.600642    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjn5\" (UniqueName: \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.602735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.602709    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl" pod "8a6c5656-0dfc-4643-9b6c-a7ece446e398" (UID: "8a6c5656-0dfc-4643-9b6c-a7ece446e398"). InnerVolumeSpecName "kube-api-access-tf9pl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:07:56.603043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.603021    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.619851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.619808    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjn5\" (UniqueName: \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\") pod \"authorino-6889cbd8c4-t62k5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") " pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:56.630188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.630152    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:07:56.633787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.633769    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.648126 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.648092    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:07:56.701932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.701897    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf9pl\" (UniqueName: \"kubernetes.io/projected/8a6c5656-0dfc-4643-9b6c-a7ece446e398-kube-api-access-tf9pl\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:56.802961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.802882    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.803118 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.803006    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt7wc\" (UniqueName: \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.903633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.903587    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.903811 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.903686    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt7wc\" (UniqueName: \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.906066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.906038    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.918074 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.918049    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt7wc\" (UniqueName: \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\") pod \"authorino-7845df6b4d-9d9s9\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") " pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:56.946180 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:56.946144    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:07:57.225246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.225221    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:07:57.227114 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:07:57.227087    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podade88456_b06c_429c_9e54_7c9c14a3cd55.slice/crio-a6066c45fe3d7db21424109f8ef0908cf2033f9692b7c32b7c8d5385500b84be WatchSource:0}: Error finding container a6066c45fe3d7db21424109f8ef0908cf2033f9692b7c32b7c8d5385500b84be: Status 404 returned error can't find the container with id a6066c45fe3d7db21424109f8ef0908cf2033f9692b7c32b7c8d5385500b84be
Oct 31 13:07:57.401618 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.401569    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" event={"ID":"ade88456-b06c-429c-9e54-7c9c14a3cd55","Type":"ContainerStarted","Data":"a6066c45fe3d7db21424109f8ef0908cf2033f9692b7c32b7c8d5385500b84be"}
Oct 31 13:07:57.403308 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.403282    4958 generic.go:356] "Generic (PLEG): container finished" podID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerID="c319764edd7186ef323d811fb62edcdf1cb35b2d1f11740795f6ca0d0d3e1c0b" exitCode=0
Oct 31 13:07:57.403434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.403362    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:57.403434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.403358    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" event={"ID":"8004ca3a-1ba4-4031-a3a0-8daf23610852","Type":"ContainerDied","Data":"c319764edd7186ef323d811fb62edcdf1cb35b2d1f11740795f6ca0d0d3e1c0b"}
Oct 31 13:07:57.403517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.403500    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-rww67"
Oct 31 13:07:57.403792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.403773    4958 scope.go:122] "RemoveContainer" containerID="c319764edd7186ef323d811fb62edcdf1cb35b2d1f11740795f6ca0d0d3e1c0b"
Oct 31 13:07:57.405067 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.405041    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:07:57.405330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.405128    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:07:57.405330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.405166    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:07:57.431403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.431376    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:57.491383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.491355    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-rww67"]
Oct 31 13:07:57.493459 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.493435    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-rww67"]
Oct 31 13:07:57.611212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.611179    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\" (UniqueName: \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\") pod \"ac680868-b0b7-40c0-b4e2-52335344fcb5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") "
Oct 31 13:07:57.611459 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.611220    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\" (UniqueName: \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\") pod \"ac680868-b0b7-40c0-b4e2-52335344fcb5\" (UID: \"ac680868-b0b7-40c0-b4e2-52335344fcb5\") "
Oct 31 13:07:57.613407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.613365    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5" pod "ac680868-b0b7-40c0-b4e2-52335344fcb5" (UID: "ac680868-b0b7-40c0-b4e2-52335344fcb5"). InnerVolumeSpecName "kube-api-access-5cjn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:07:57.613709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.613683    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert" pod "ac680868-b0b7-40c0-b4e2-52335344fcb5" (UID: "ac680868-b0b7-40c0-b4e2-52335344fcb5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:07:57.712697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.712653    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cjn5\" (UniqueName: \"kubernetes.io/projected/ac680868-b0b7-40c0-b4e2-52335344fcb5-kube-api-access-5cjn5\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:57.712697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:57.712682    4958 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac680868-b0b7-40c0-b4e2-52335344fcb5-tls-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:07:58.411722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.411670    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" event={"ID":"8004ca3a-1ba4-4031-a3a0-8daf23610852","Type":"ContainerStarted","Data":"f53c01d993f6f42a67988119e5964df6ab9a4f721758c2bf9f05f823545a7580"}
Oct 31 13:07:58.414028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.413996    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" event={"ID":"ade88456-b06c-429c-9e54-7c9c14a3cd55","Type":"ContainerStarted","Data":"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"}
Oct 31 13:07:58.414201 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.414090    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-t62k5"
Oct 31 13:07:58.476734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.476680    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" podStartSLOduration=1.461607641 podStartE2EDuration="2.47666653s" totalImagesPullingTime="1.015058889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:07:58.475254596 +0000 UTC m=+500.138680304" watchObservedRunningTime="2026-10-31 13:07:58.47666653 +0000 UTC m=+500.140092231"
Oct 31 13:07:58.493661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.493583    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a6c5656-0dfc-4643-9b6c-a7ece446e398" path="/var/lib/kubelet/pods/8a6c5656-0dfc-4643-9b6c-a7ece446e398/volumes"
Oct 31 13:07:58.509774 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.509741    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-t62k5"]
Oct 31 13:07:58.556043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:58.556003    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-t62k5"]
Oct 31 13:07:59.015358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:59.015309    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:07:59.015695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:59.015667    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 31 13:07:59.015770 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:07:59.015747    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 31 13:07:59.573769 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:07:59.573730    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:08:00.015157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:00.015121    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 31 13:08:00.015340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:00.015176    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 31 13:08:00.489691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:00.489656    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac680868-b0b7-40c0-b4e2-52335344fcb5" path="/var/lib/kubelet/pods/ac680868-b0b7-40c0-b4e2-52335344fcb5/volumes"
Oct 31 13:08:01.015906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:01.015875    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 31 13:08:01.016320 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:01.015941    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 31 13:08:02.015031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:02.014994    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 31 13:08:02.015215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:02.015052    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 31 13:08:03.015538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:03.015490    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 31 13:08:03.016021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:03.015569    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 31 13:08:04.019095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:04.019064    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:08:04.019458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:04.019430    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:08:04.020173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:04.020153    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk"
Oct 31 13:08:06.214492 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.214450    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:08:06.214933 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.214735    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" podUID="8941db28-5d20-4c49-a48e-18ca4864f52c" containerName="maas-api" containerID="cri-o://d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87" gracePeriod=30
Oct 31 13:08:06.463559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.463522    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:08:06.483224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.483133    4958 generic.go:356] "Generic (PLEG): container finished" podID="8941db28-5d20-4c49-a48e-18ca4864f52c" containerID="d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87" exitCode=0
Oct 31 13:08:06.483224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.483180    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"
Oct 31 13:08:06.483224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.483215    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" event={"ID":"8941db28-5d20-4c49-a48e-18ca4864f52c","Type":"ContainerDied","Data":"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"}
Oct 31 13:08:06.483431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.483272    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq" event={"ID":"8941db28-5d20-4c49-a48e-18ca4864f52c","Type":"ContainerDied","Data":"0d88ad55d9198c53d013d071e73695206b0c5d56c9c62acb80d1a7e2b1bf4f30"}
Oct 31 13:08:06.483431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.483333    4958 scope.go:122] "RemoveContainer" containerID="d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"
Oct 31 13:08:06.495900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.495878    4958 scope.go:122] "RemoveContainer" containerID="d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"
Oct 31 13:08:06.496206 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:08:06.496186    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87\": container with ID starting with d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87 not found: ID does not exist" containerID="d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"
Oct 31 13:08:06.496260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.496217    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87"} err="failed to get container status \"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87\": rpc error: code = NotFound desc = could not find container \"d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87\": container with ID starting with d7fdfca81481735ec8d62c21e1bcbf03fe78acedf82cee3ec2755a3ef1bcde87 not found: ID does not exist"
Oct 31 13:08:06.521749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.521711    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\") pod \"8941db28-5d20-4c49-a48e-18ca4864f52c\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") "
Oct 31 13:08:06.521907 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.521788    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\" (UniqueName: \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\") pod \"8941db28-5d20-4c49-a48e-18ca4864f52c\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") "
Oct 31 13:08:06.521907 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.521866    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\") pod \"8941db28-5d20-4c49-a48e-18ca4864f52c\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") "
Oct 31 13:08:06.521907 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.521885    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\") pod \"8941db28-5d20-4c49-a48e-18ca4864f52c\" (UID: \"8941db28-5d20-4c49-a48e-18ca4864f52c\") "
Oct 31 13:08:06.522090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.522063    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca" pod "8941db28-5d20-4c49-a48e-18ca4864f52c" (UID: "8941db28-5d20-4c49-a48e-18ca4864f52c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:08:06.524103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.524072    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs" pod "8941db28-5d20-4c49-a48e-18ca4864f52c" (UID: "8941db28-5d20-4c49-a48e-18ca4864f52c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:08:06.524232 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.524118    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls" pod "8941db28-5d20-4c49-a48e-18ca4864f52c" (UID: "8941db28-5d20-4c49-a48e-18ca4864f52c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:08:06.524295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.524224    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7" pod "8941db28-5d20-4c49-a48e-18ca4864f52c" (UID: "8941db28-5d20-4c49-a48e-18ca4864f52c"). InnerVolumeSpecName "kube-api-access-mtfs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:08:06.623139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.623097    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:08:06.623139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.623133    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8941db28-5d20-4c49-a48e-18ca4864f52c-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:08:06.623139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.623144    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8941db28-5d20-4c49-a48e-18ca4864f52c-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:08:06.623382 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.623154    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtfs7\" (UniqueName: \"kubernetes.io/projected/8941db28-5d20-4c49-a48e-18ca4864f52c-kube-api-access-mtfs7\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:08:06.809195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.809157    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:08:06.813649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:06.813615    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-nprxq"]
Oct 31 13:08:08.497109 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:08.497068    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8941db28-5d20-4c49-a48e-18ca4864f52c" path="/var/lib/kubelet/pods/8941db28-5d20-4c49-a48e-18ca4864f52c/volumes"
Oct 31 13:08:28.814217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:28.814182    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:29.572093 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:08:29.572058    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:08:32.569823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:32.569779    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:32.715991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:32.715956    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:53.692628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.692577    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-phqcd"]
Oct 31 13:08:53.693516 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.693492    4958 cpu_manager.go:414] "containerMap: removing container" podUID="8941db28-5d20-4c49-a48e-18ca4864f52c" containerName="maas-api"
Oct 31 13:08:53.693516 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.693514    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8941db28-5d20-4c49-a48e-18ca4864f52c" containerName="maas-api"
Oct 31 13:08:53.693701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.693592    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="8941db28-5d20-4c49-a48e-18ca4864f52c" containerName="maas-api"
Oct 31 13:08:53.696317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.696297    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.702087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.702067    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 13:08:53.703515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.703297    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 13:08:53.703743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.703716    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tcfhh\""
Oct 31 13:08:53.703830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.703774    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 31 13:08:53.712858 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.712829    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-phqcd"]
Oct 31 13:08:53.814631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.814589    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:53.854782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.854747    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.854782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.854783    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46cb9\" (UniqueName: \"kubernetes.io/projected/b632adad-3bd9-4a9b-a19a-decf5cbaad88-kube-api-access-46cb9\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.854974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.854809    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-home\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.854974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.854912    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.854974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.854939    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.855071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.855033    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.955985    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956027    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46cb9\" (UniqueName: \"kubernetes.io/projected/b632adad-3bd9-4a9b-a19a-decf5cbaad88-kube-api-access-46cb9\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956153    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-home\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956215    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956239    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956318    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956406    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956535 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956494    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-home\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.956622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.956582    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.958649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.958597    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b632adad-3bd9-4a9b-a19a-decf5cbaad88-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.958854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.958835    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b632adad-3bd9-4a9b-a19a-decf5cbaad88-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:53.972917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:53.972883    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46cb9\" (UniqueName: \"kubernetes.io/projected/b632adad-3bd9-4a9b-a19a-decf5cbaad88-kube-api-access-46cb9\") pod \"echo-simulator-kserve-64b6f8f96c-phqcd\" (UID: \"b632adad-3bd9-4a9b-a19a-decf5cbaad88\") " pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:54.009544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:54.009508    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:54.296919 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:54.296880    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-phqcd"]
Oct 31 13:08:54.299202 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:08:54.299170    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb632adad_3bd9_4a9b_a19a_decf5cbaad88.slice/crio-49259cad800a7213170ed96e7d751b0b98b87bd40006ebb120973b62bde04947 WatchSource:0}: Error finding container 49259cad800a7213170ed96e7d751b0b98b87bd40006ebb120973b62bde04947: Status 404 returned error can't find the container with id 49259cad800a7213170ed96e7d751b0b98b87bd40006ebb120973b62bde04947
Oct 31 13:08:54.752237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:54.752190    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd" event={"ID":"b632adad-3bd9-4a9b-a19a-decf5cbaad88","Type":"ContainerStarted","Data":"49259cad800a7213170ed96e7d751b0b98b87bd40006ebb120973b62bde04947"}
Oct 31 13:08:55.492183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.492148    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"]
Oct 31 13:08:55.496576 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.496550    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.505469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.505439    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"]
Oct 31 13:08:55.505730 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.505696    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 31 13:08:55.579593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.579559    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:55.674337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674299    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.674524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674353    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw6pq\" (UniqueName: \"kubernetes.io/projected/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-kube-api-access-fw6pq\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.674524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674471    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.674524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674500    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.674746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674620    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.674746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.674694    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776226    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776316    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776349    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw6pq\" (UniqueName: \"kubernetes.io/projected/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-kube-api-access-fw6pq\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776395    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776422    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776484    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776765    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.776904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.776881    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.777218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.777029    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.779326 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.779292    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.779543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.779519    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.790926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.790891    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw6pq\" (UniqueName: \"kubernetes.io/projected/109b96d7-5cce-4f03-93b3-96dcacc4c5e1-kube-api-access-fw6pq\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-znknb\" (UID: \"109b96d7-5cce-4f03-93b3-96dcacc4c5e1\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:55.816589 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:55.816554    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:56.111716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:56.111664    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"]
Oct 31 13:08:56.311601 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:56.311520    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:56.789629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:56.788826    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd" event={"ID":"b632adad-3bd9-4a9b-a19a-decf5cbaad88","Type":"ContainerStarted","Data":"c2abb2e9dc1d0dd365258579367ba16ffe389f04a09d9c3d3de4b8cd6b267f37"}
Oct 31 13:08:56.791633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:56.791591    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb" event={"ID":"109b96d7-5cce-4f03-93b3-96dcacc4c5e1","Type":"ContainerStarted","Data":"d9ec7140afe62324688ea81c171a3705d9b820f21bb357cd6b6fbaa0d33f59e1"}
Oct 31 13:08:56.821727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:56.821654    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd" podStartSLOduration=2.106159941 podStartE2EDuration="3.82163499s" totalImagesPullingTime="1.715475049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:08:56.818959697 +0000 UTC m=+558.482385401" watchObservedRunningTime="2026-10-31 13:08:56.82163499 +0000 UTC m=+558.485060675"
Oct 31 13:08:57.009939 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:57.009843    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:08:58.717402 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:58.717360    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:58.804900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:58.804864    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb" event={"ID":"109b96d7-5cce-4f03-93b3-96dcacc4c5e1","Type":"ContainerStarted","Data":"4805cebd118d58a2c4755a8e71d3ee1b6315bbf23f8466dadc6e136fe193fd3f"}
Oct 31 13:08:58.817701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:58.817668    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:08:58.830352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:58.830299    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb" podStartSLOduration=2.102450217 podStartE2EDuration="3.830285576s" totalImagesPullingTime="1.727835359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:08:58.827483405 +0000 UTC m=+560.490909127" watchObservedRunningTime="2026-10-31 13:08:58.830285576 +0000 UTC m=+560.493711299"
Oct 31 13:08:59.467364 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.467316    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"]
Oct 31 13:08:59.471684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.471649    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.481100 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.480811    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 31 13:08:59.485107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.485075    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"]
Oct 31 13:08:59.521674 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521632    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.521674 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521686    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.521929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521715    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/9d2c6943-45b9-4289-bae9-8e2a58277a2e-kube-api-access-4cjhg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.521929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521838    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.522043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521940    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.522043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.521997    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.564489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.564451    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:08:59.573718 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:08:59.573684    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:08:59.622438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622398    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.622649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622536    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.622649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622558    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.622649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622574    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/9d2c6943-45b9-4289-bae9-8e2a58277a2e-kube-api-access-4cjhg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.622649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622595    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.622883 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622653    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.623023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.622999    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.623087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.623020    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.623087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.623047    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.624926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.624898    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2c6943-45b9-4289-bae9-8e2a58277a2e-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.625039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.624995    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2c6943-45b9-4289-bae9-8e2a58277a2e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.639222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.639191    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/9d2c6943-45b9-4289-bae9-8e2a58277a2e-kube-api-access-4cjhg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-47ncd\" (UID: \"9d2c6943-45b9-4289-bae9-8e2a58277a2e\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:08:59.789645 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:08:59.789544    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:09:00.076732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:00.076701    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"]
Oct 31 13:09:00.079226 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:00.079155    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2c6943_45b9_4289_bae9_8e2a58277a2e.slice/crio-d98353145d31c48e01b109079e0236bb0e98404ef345cd260db5ef6fd7b8bc93 WatchSource:0}: Error finding container d98353145d31c48e01b109079e0236bb0e98404ef345cd260db5ef6fd7b8bc93: Status 404 returned error can't find the container with id d98353145d31c48e01b109079e0236bb0e98404ef345cd260db5ef6fd7b8bc93
Oct 31 13:09:00.717883 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:00.717852    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:00.822020 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:00.821969    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd" event={"ID":"9d2c6943-45b9-4289-bae9-8e2a58277a2e","Type":"ContainerStarted","Data":"ea25c18226b74bc0bbc851f2b9f7b69038a8023639668940d1c414c8c0e40ee6"}
Oct 31 13:09:00.822667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:00.822057    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd" event={"ID":"9d2c6943-45b9-4289-bae9-8e2a58277a2e","Type":"ContainerStarted","Data":"d98353145d31c48e01b109079e0236bb0e98404ef345cd260db5ef6fd7b8bc93"}
Oct 31 13:09:00.853094 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:00.853013    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd" podStartSLOduration=1.563026198 podStartE2EDuration="1.852992244s" totalImagesPullingTime="289.966046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:00.85089237 +0000 UTC m=+562.514318054" watchObservedRunningTime="2026-10-31 13:09:00.852992244 +0000 UTC m=+562.516417934"
Oct 31 13:09:01.790705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:01.790663    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:09:01.821432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:01.821391    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:02.117352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.117262    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"]
Oct 31 13:09:02.121157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.121128    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.129524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.129496    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 31 13:09:02.143785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.143744    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"]
Oct 31 13:09:02.157184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157128    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.157345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157251    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.157345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157291    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.157424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157362    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.157499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157476    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwtt\" (UniqueName: \"kubernetes.io/projected/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-kube-api-access-xfwtt\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.157557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.157544    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.253282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.253246    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:02.258587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258549    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwtt\" (UniqueName: \"kubernetes.io/projected/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-kube-api-access-xfwtt\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.258810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258669    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.258810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258714    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.258810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258760    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.258978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258798    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.258978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.258847    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.259352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.259324    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.259514 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.259350    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.259643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.259626    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.261583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.261551    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.262139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.262118    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.275304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.275275    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwtt\" (UniqueName: \"kubernetes.io/projected/95a8a6be-4e22-4fe6-9748-c09d14e75fbe-kube-api-access-xfwtt\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2d9pm\" (UID: \"95a8a6be-4e22-4fe6-9748-c09d14e75fbe\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.436144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.436063    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:02.720838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.720805    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"]
Oct 31 13:09:02.722419 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:02.722390    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a8a6be_4e22_4fe6_9748_c09d14e75fbe.slice/crio-a3ebe6e0431b0231018cc971943b55ba242f4777bcb4fd4eec48db272ad36eb5 WatchSource:0}: Error finding container a3ebe6e0431b0231018cc971943b55ba242f4777bcb4fd4eec48db272ad36eb5: Status 404 returned error can't find the container with id a3ebe6e0431b0231018cc971943b55ba242f4777bcb4fd4eec48db272ad36eb5
Oct 31 13:09:02.836095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:02.836056    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm" event={"ID":"95a8a6be-4e22-4fe6-9748-c09d14e75fbe","Type":"ContainerStarted","Data":"a3ebe6e0431b0231018cc971943b55ba242f4777bcb4fd4eec48db272ad36eb5"}
Oct 31 13:09:03.512988 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:03.512910    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:03.843899 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:03.843798    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm" event={"ID":"95a8a6be-4e22-4fe6-9748-c09d14e75fbe","Type":"ContainerStarted","Data":"4556eb9db930163adbb41702651bbb023bdb6f5daefcebdbfbb021b81cc7a86a"}
Oct 31 13:09:03.868494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:03.868430    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm" podStartSLOduration=1.606750187 podStartE2EDuration="1.86841621s" totalImagesPullingTime="261.666023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:03.865853099 +0000 UTC m=+565.529278817" watchObservedRunningTime="2026-10-31 13:09:03.86841621 +0000 UTC m=+565.531841929"
Oct 31 13:09:04.010489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:04.010448    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:09:04.028102 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:04.028071    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:09:04.436989 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:04.436953    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:04.873180 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:04.873147    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-phqcd"
Oct 31 13:09:05.817701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:05.817653    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:09:05.830645 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:05.830595    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:09:05.872136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:05.872104    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-znknb"
Oct 31 13:09:09.789762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:09.789720    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:09:09.802778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:09.802751    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:09:09.907163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:09.907132    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-47ncd"
Oct 31 13:09:12.436899 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:12.436854    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:12.449822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:12.449795    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:12.930514 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:12.930484    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2d9pm"
Oct 31 13:09:20.437120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.437040    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f9bd99bd7-xgjh6"]
Oct 31 13:09:20.440830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.440810    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.467742 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.467711    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9bd99bd7-xgjh6"]
Oct 31 13:09:20.554991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.554953    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-tls-cert\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.555173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.555113    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87bv\" (UniqueName: \"kubernetes.io/projected/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-kube-api-access-m87bv\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.656986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.656948    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-tls-cert\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.657161 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.657038    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m87bv\" (UniqueName: \"kubernetes.io/projected/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-kube-api-access-m87bv\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.659559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.659532    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-tls-cert\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.672468 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.672439    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87bv\" (UniqueName: \"kubernetes.io/projected/bccdfb5f-3fa7-4e49-bf95-038ba12b269b-kube-api-access-m87bv\") pod \"authorino-7f9bd99bd7-xgjh6\" (UID: \"bccdfb5f-3fa7-4e49-bf95-038ba12b269b\") " pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:20.753814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:20.753765    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6"
Oct 31 13:09:21.042558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:21.042529    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9bd99bd7-xgjh6"]
Oct 31 13:09:21.045132 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:21.045101    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbccdfb5f_3fa7_4e49_bf95_038ba12b269b.slice/crio-ab5f92018fcb3f84ba41c00340290dca774cf58f198f8bc8e90d133e298e4c24 WatchSource:0}: Error finding container ab5f92018fcb3f84ba41c00340290dca774cf58f198f8bc8e90d133e298e4c24: Status 404 returned error can't find the container with id ab5f92018fcb3f84ba41c00340290dca774cf58f198f8bc8e90d133e298e4c24
Oct 31 13:09:21.966392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:21.966338    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6" event={"ID":"bccdfb5f-3fa7-4e49-bf95-038ba12b269b","Type":"ContainerStarted","Data":"ab5f92018fcb3f84ba41c00340290dca774cf58f198f8bc8e90d133e298e4c24"}
Oct 31 13:09:22.975011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:22.974971    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6" event={"ID":"bccdfb5f-3fa7-4e49-bf95-038ba12b269b","Type":"ContainerStarted","Data":"d2a42286dee299085e67626dc55b8eaf97923df9e822a1c55607241e00935ef7"}
Oct 31 13:09:23.066782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.063522    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7f9bd99bd7-xgjh6" podStartSLOduration=1.801081446 podStartE2EDuration="3.063500005s" totalImagesPullingTime="1.262418559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:23.011437797 +0000 UTC m=+584.674863480" watchObservedRunningTime="2026-10-31 13:09:23.063500005 +0000 UTC m=+584.726925687"
Oct 31 13:09:23.066782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.064659    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:09:23.066782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.064834    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" podUID="ade88456-b06c-429c-9e54-7c9c14a3cd55" containerName="authorino" containerID="cri-o://e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba" gracePeriod=30
Oct 31 13:09:23.330904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.330875    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:09:23.485518 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.485485    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\" (UniqueName: \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\") pod \"ade88456-b06c-429c-9e54-7c9c14a3cd55\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") "
Oct 31 13:09:23.485760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.485559    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\" (UniqueName: \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\") pod \"ade88456-b06c-429c-9e54-7c9c14a3cd55\" (UID: \"ade88456-b06c-429c-9e54-7c9c14a3cd55\") "
Oct 31 13:09:23.487859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.487823    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc" pod "ade88456-b06c-429c-9e54-7c9c14a3cd55" (UID: "ade88456-b06c-429c-9e54-7c9c14a3cd55"). InnerVolumeSpecName "kube-api-access-nt7wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:09:23.498065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.498029    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert" pod "ade88456-b06c-429c-9e54-7c9c14a3cd55" (UID: "ade88456-b06c-429c-9e54-7c9c14a3cd55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:09:23.586853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.586800    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt7wc\" (UniqueName: \"kubernetes.io/projected/ade88456-b06c-429c-9e54-7c9c14a3cd55-kube-api-access-nt7wc\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:09:23.586853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.586840    4958 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ade88456-b06c-429c-9e54-7c9c14a3cd55-tls-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:09:23.700972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.700932    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:23.701409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.701385    4958 cpu_manager.go:414] "containerMap: removing container" podUID="ade88456-b06c-429c-9e54-7c9c14a3cd55" containerName="authorino"
Oct 31 13:09:23.701409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.701402    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ade88456-b06c-429c-9e54-7c9c14a3cd55" containerName="authorino"
Oct 31 13:09:23.701570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.701494    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="ade88456-b06c-429c-9e54-7c9c14a3cd55" containerName="authorino"
Oct 31 13:09:23.704750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.704714    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.714107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.714067    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 31 13:09:23.715036 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.715018    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-xpjzx\""
Oct 31 13:09:23.715133 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.715017    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 31 13:09:23.722526 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.722487    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:23.789316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.789232    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.789316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.789294    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtpkh\" (UniqueName: \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.832878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.832840    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:23.891078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.891034    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.891311 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.891115    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtpkh\" (UniqueName: \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.894173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.894142    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.907556 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.907514    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtpkh\" (UniqueName: \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\") pod \"ai-gateway-controller-6cf7bcbfb6-ksnth\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") " pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:23.982619 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.982577    4958 generic.go:356] "Generic (PLEG): container finished" podID="ade88456-b06c-429c-9e54-7c9c14a3cd55" containerID="e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba" exitCode=0
Oct 31 13:09:23.983125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.982663    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7845df6b4d-9d9s9"
Oct 31 13:09:23.983125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.982774    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" event={"ID":"ade88456-b06c-429c-9e54-7c9c14a3cd55","Type":"ContainerDied","Data":"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"}
Oct 31 13:09:23.983125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.982815    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7845df6b4d-9d9s9" event={"ID":"ade88456-b06c-429c-9e54-7c9c14a3cd55","Type":"ContainerDied","Data":"a6066c45fe3d7db21424109f8ef0908cf2033f9692b7c32b7c8d5385500b84be"}
Oct 31 13:09:23.983125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.982838    4958 scope.go:122] "RemoveContainer" containerID="e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"
Oct 31 13:09:23.998315 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.998282    4958 scope.go:122] "RemoveContainer" containerID="e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"
Oct 31 13:09:23.998645 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:09:23.998620    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba\": container with ID starting with e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba not found: ID does not exist" containerID="e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"
Oct 31 13:09:23.998748 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:23.998655    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba"} err="failed to get container status \"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba\": rpc error: code = NotFound desc = could not find container \"e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba\": container with ID starting with e272d496655f3ca436315c66703bda3523cf48b1f6607b4b2b1e626094f037ba not found: ID does not exist"
Oct 31 13:09:24.014565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.014533    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:09:24.016198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.016173    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:24.020079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.020059    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:24.022144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.022108    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7845df6b4d-9d9s9"]
Oct 31 13:09:24.314284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.314256    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:24.315321 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:24.315284    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e278c02_f16d_424f_8c46_7bdc18f54569.slice/crio-b514b0da5148970272c1fee94b5be6a51ce8f6333b18d9fd40b60718885c882b WatchSource:0}: Error finding container b514b0da5148970272c1fee94b5be6a51ce8f6333b18d9fd40b60718885c882b: Status 404 returned error can't find the container with id b514b0da5148970272c1fee94b5be6a51ce8f6333b18d9fd40b60718885c882b
Oct 31 13:09:24.490526 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.490490    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ade88456-b06c-429c-9e54-7c9c14a3cd55" path="/var/lib/kubelet/pods/ade88456-b06c-429c-9e54-7c9c14a3cd55/volumes"
Oct 31 13:09:24.990622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:24.990576    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" event={"ID":"0e278c02-f16d-424f-8c46-7bdc18f54569","Type":"ContainerStarted","Data":"b514b0da5148970272c1fee94b5be6a51ce8f6333b18d9fd40b60718885c882b"}
Oct 31 13:09:25.223125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.223086    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"]
Oct 31 13:09:25.229758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.229719    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.271380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.271342    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"]
Oct 31 13:09:25.303702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.303659    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.303702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.303705    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.303743    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.303768    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.303903    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.304020    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.304061    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6lv\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-kube-api-access-ql6lv\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.304093    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.304177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.304113    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405627    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405689    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405744    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405772    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405805    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405867    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.405937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405908    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6lv\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-kube-api-access-ql6lv\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405956    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.405989    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.406143    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.406183    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.406382    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.406588    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.406848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.406824    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.408380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.408354    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.408670 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.408652    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.447202 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.447169    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6lv\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-kube-api-access-ql6lv\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.447587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.447560    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e7c5fa-8d1f-4eeb-b751-29f89354870f-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bmrjc\" (UID: \"f3e7c5fa-8d1f-4eeb-b751-29f89354870f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.547548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.547448    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:25.841468 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:25.841421    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e7c5fa_8d1f_4eeb_b751_29f89354870f.slice/crio-13d44b104042cd0fdfd34729d5d6925f193af823cd72cf113046e2a950ae65d5 WatchSource:0}: Error finding container 13d44b104042cd0fdfd34729d5d6925f193af823cd72cf113046e2a950ae65d5: Status 404 returned error can't find the container with id 13d44b104042cd0fdfd34729d5d6925f193af823cd72cf113046e2a950ae65d5
Oct 31 13:09:25.842697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.842667    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"]
Oct 31 13:09:25.843878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.843845    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:09:25.843982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.843912    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:09:25.843982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:25.843948    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:09:26.000628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.000215    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" event={"ID":"f3e7c5fa-8d1f-4eeb-b751-29f89354870f","Type":"ContainerStarted","Data":"e160bef40925d5cbbd0a74f4eadbc61c339b8c6101c88127add2fc9f34a85bbf"}
Oct 31 13:09:26.000628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.000282    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" event={"ID":"f3e7c5fa-8d1f-4eeb-b751-29f89354870f","Type":"ContainerStarted","Data":"13d44b104042cd0fdfd34729d5d6925f193af823cd72cf113046e2a950ae65d5"}
Oct 31 13:09:26.051270 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.051189    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podStartSLOduration=1.051170316 podStartE2EDuration="1.051170316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:26.045565736 +0000 UTC m=+587.708991441" watchObservedRunningTime="2026-10-31 13:09:26.051170316 +0000 UTC m=+587.714596001"
Oct 31 13:09:26.548737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.548654    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:26.549997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.549698    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:26.549997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:26.549759    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:27.548845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:27.548801    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:27.549404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:27.548864    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:28.553442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:28.551720    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:28.553442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:28.551781    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:28.648041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:28.647939    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:28.917404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:28.917294    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:29.031636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.031242    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" event={"ID":"0e278c02-f16d-424f-8c46-7bdc18f54569","Type":"ContainerStarted","Data":"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"}
Oct 31 13:09:29.034639 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.032361    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:29.063941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.063864    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" podStartSLOduration=1.881742768 podStartE2EDuration="6.063845925s" totalImagesPullingTime="4.182103157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:29.060926444 +0000 UTC m=+590.724352128" watchObservedRunningTime="2026-10-31 13:09:29.063845925 +0000 UTC m=+590.727271609"
Oct 31 13:09:29.499918 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.499876    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:29.507308 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.507274    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"]
Oct 31 13:09:29.511217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.511185    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.557008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.553117    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ld4xt\""
Oct 31 13:09:29.557008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.553143    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:29.557008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.553217    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:29.557008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.556328    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"]
Oct 31 13:09:29.561031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.559169    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"]
Oct 31 13:09:29.561031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.560752    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 31 13:09:29.563191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.563170    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.578736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.578697    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"]
Oct 31 13:09:29.609114 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:09:29.609045    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:09:29.690926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.690883    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpxz5\" (UniqueName: \"kubernetes.io/projected/fcb13701-f912-4e8f-bebf-224b7961db0d-kube-api-access-cpxz5\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.691130 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.691020    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcb13701-f912-4e8f-bebf-224b7961db0d-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.691130 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.691070    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16733691-44ea-4a9e-9961-2c27deab4dd9-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.691130 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.691092    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdf7\" (UniqueName: \"kubernetes.io/projected/16733691-44ea-4a9e-9961-2c27deab4dd9-kube-api-access-4kdf7\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.750652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.750473    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:29.792003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.791966    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpxz5\" (UniqueName: \"kubernetes.io/projected/fcb13701-f912-4e8f-bebf-224b7961db0d-kube-api-access-cpxz5\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.792383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.792363    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcb13701-f912-4e8f-bebf-224b7961db0d-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.792458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.792410    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16733691-44ea-4a9e-9961-2c27deab4dd9-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.792458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.792425    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdf7\" (UniqueName: \"kubernetes.io/projected/16733691-44ea-4a9e-9961-2c27deab4dd9-kube-api-access-4kdf7\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.793458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.793430    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16733691-44ea-4a9e-9961-2c27deab4dd9-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.793584 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.793569    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcb13701-f912-4e8f-bebf-224b7961db0d-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.808258 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.808208    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdf7\" (UniqueName: \"kubernetes.io/projected/16733691-44ea-4a9e-9961-2c27deab4dd9-kube-api-access-4kdf7\") pod \"payload-processing-55fbbbf9dc-9j4zt\" (UID: \"16733691-44ea-4a9e-9961-2c27deab4dd9\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:29.809109 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.809068    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpxz5\" (UniqueName: \"kubernetes.io/projected/fcb13701-f912-4e8f-bebf-224b7961db0d-kube-api-access-cpxz5\") pod \"payload-pre-processing-7b98bb678c-z4vmd\" (UID: \"fcb13701-f912-4e8f-bebf-224b7961db0d\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.866646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.865565    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:29.910142 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:29.910105    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:30.203422 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:30.203197    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"]
Oct 31 13:09:30.204963 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:30.204930    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb13701_f912_4e8f_bebf_224b7961db0d.slice/crio-1045122ad8ddf38c05bff4dc3783fee7d5904d170e56b256e9bd201d19de75c9 WatchSource:0}: Error finding container 1045122ad8ddf38c05bff4dc3783fee7d5904d170e56b256e9bd201d19de75c9: Status 404 returned error can't find the container with id 1045122ad8ddf38c05bff4dc3783fee7d5904d170e56b256e9bd201d19de75c9
Oct 31 13:09:30.266112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:30.266080    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"]
Oct 31 13:09:30.266866 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:30.266841    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16733691_44ea_4a9e_9961_2c27deab4dd9.slice/crio-02195f697aded4d1b2f5699379d2190a356a0875889c75cfad883d72002af393 WatchSource:0}: Error finding container 02195f697aded4d1b2f5699379d2190a356a0875889c75cfad883d72002af393: Status 404 returned error can't find the container with id 02195f697aded4d1b2f5699379d2190a356a0875889c75cfad883d72002af393
Oct 31 13:09:30.551159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:30.551120    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:30.551438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:30.551409    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:31.074992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:31.074932    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd" event={"ID":"fcb13701-f912-4e8f-bebf-224b7961db0d","Type":"ContainerStarted","Data":"1045122ad8ddf38c05bff4dc3783fee7d5904d170e56b256e9bd201d19de75c9"}
Oct 31 13:09:31.077395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:31.077367    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt" event={"ID":"16733691-44ea-4a9e-9961-2c27deab4dd9","Type":"ContainerStarted","Data":"02195f697aded4d1b2f5699379d2190a356a0875889c75cfad883d72002af393"}
Oct 31 13:09:31.550096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:31.550047    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:31.550289 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:31.550116    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:32.548442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:32.548401    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:32.548969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:32.548466    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:33.547889 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:33.547846    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 13:09:33.548119 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:33.547909    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 13:09:34.105649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.105583    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd" event={"ID":"fcb13701-f912-4e8f-bebf-224b7961db0d","Type":"ContainerStarted","Data":"8d443db6a8e2cdfaa41ff8586dc85d143a99458fbc7690ac0abfb0b511f217b3"}
Oct 31 13:09:34.106150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.105685    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:34.107505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.107475    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt" event={"ID":"16733691-44ea-4a9e-9961-2c27deab4dd9","Type":"ContainerStarted","Data":"4295a1d9c68efb2ab63f168a3aff8596226621a3c90b149e98674a5148f3b5af"}
Oct 31 13:09:34.107647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.107541    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:34.131334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.131276    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd" podStartSLOduration=2.260271429 podStartE2EDuration="5.131257519s" totalImagesPullingTime="2.87098609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:34.126729434 +0000 UTC m=+595.790155121" watchObservedRunningTime="2026-10-31 13:09:34.131257519 +0000 UTC m=+595.794683205"
Oct 31 13:09:34.153158 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:34.153108    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt" podStartSLOduration=2.402469045 podStartE2EDuration="5.15309552s" totalImagesPullingTime="2.750626475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:34.150212233 +0000 UTC m=+595.813637918" watchObservedRunningTime="2026-10-31 13:09:34.15309552 +0000 UTC m=+595.816521204"
Oct 31 13:09:35.589785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:35.589746    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:09:35.590193 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:35.589806    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:09:36.436398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:36.436362    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:36.436752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:36.436646    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:36.437539 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:36.437515    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc"
Oct 31 13:09:38.559760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:38.559732    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:09:38.560790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:38.560764    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:09:38.567338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:38.567311    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:09:38.568489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:38.568464    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:09:41.080153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.080122    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:41.351265 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.351178    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"]
Oct 31 13:09:41.356687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.356661    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.365823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.365793    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"]
Oct 31 13:09:41.445159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.445113    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78sb5\" (UniqueName: \"kubernetes.io/projected/7e0c3990-fbbc-4f04-b612-00299831ff6b-kube-api-access-78sb5\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.445332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.445287    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0c3990-fbbc-4f04-b612-00299831ff6b-metrics-certs\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.546231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.546181    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0c3990-fbbc-4f04-b612-00299831ff6b-metrics-certs\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.546404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.546296    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sb5\" (UniqueName: \"kubernetes.io/projected/7e0c3990-fbbc-4f04-b612-00299831ff6b-kube-api-access-78sb5\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.548941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.548907    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0c3990-fbbc-4f04-b612-00299831ff6b-metrics-certs\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.560543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.560504    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sb5\" (UniqueName: \"kubernetes.io/projected/7e0c3990-fbbc-4f04-b612-00299831ff6b-kube-api-access-78sb5\") pod \"ai-gateway-controller-5b47c5f478-vbcwg\" (UID: \"7e0c3990-fbbc-4f04-b612-00299831ff6b\") " pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.672997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.672907    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:41.952681 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:41.952647    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"]
Oct 31 13:09:41.953791 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:09:41.953750    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0c3990_fbbc_4f04_b612_00299831ff6b.slice/crio-d0140f7297ae1e6283ff2e28833ffc0e78efd060eb42b3521cfa2b0d0c75ce24 WatchSource:0}: Error finding container d0140f7297ae1e6283ff2e28833ffc0e78efd060eb42b3521cfa2b0d0c75ce24: Status 404 returned error can't find the container with id d0140f7297ae1e6283ff2e28833ffc0e78efd060eb42b3521cfa2b0d0c75ce24
Oct 31 13:09:42.155064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:42.155028    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg" event={"ID":"7e0c3990-fbbc-4f04-b612-00299831ff6b","Type":"ContainerStarted","Data":"d0140f7297ae1e6283ff2e28833ffc0e78efd060eb42b3521cfa2b0d0c75ce24"}
Oct 31 13:09:43.162837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:43.162803    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg" event={"ID":"7e0c3990-fbbc-4f04-b612-00299831ff6b","Type":"ContainerStarted","Data":"656a6525cc265d15baf925e9b15cb947687f20231923b587969a6609944057e1"}
Oct 31 13:09:43.163232 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:43.162875    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:43.188070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:43.188015    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg" podStartSLOduration=1.7959460109999998 podStartE2EDuration="2.187999248s" totalImagesPullingTime="392.053237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:09:43.187649892 +0000 UTC m=+604.851075576" watchObservedRunningTime="2026-10-31 13:09:43.187999248 +0000 UTC m=+604.851424932"
Oct 31 13:09:45.116391 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:45.116358    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-9j4zt"
Oct 31 13:09:45.116917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:45.116440    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-z4vmd"
Oct 31 13:09:50.390033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:50.389999    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:54.172065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.172033    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5b47c5f478-vbcwg"
Oct 31 13:09:54.224826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.224787    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:54.225284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.225254    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" podUID="0e278c02-f16d-424f-8c46-7bdc18f54569" containerName="manager" containerID="cri-o://632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578" gracePeriod=30
Oct 31 13:09:54.481815 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.481786    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:54.576005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.575969    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\") pod \"0e278c02-f16d-424f-8c46-7bdc18f54569\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") "
Oct 31 13:09:54.576201 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.576032    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\" (UniqueName: \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\") pod \"0e278c02-f16d-424f-8c46-7bdc18f54569\" (UID: \"0e278c02-f16d-424f-8c46-7bdc18f54569\") "
Oct 31 13:09:54.578202 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.578172    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs" pod "0e278c02-f16d-424f-8c46-7bdc18f54569" (UID: "0e278c02-f16d-424f-8c46-7bdc18f54569"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:09:54.578318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.578221    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh" pod "0e278c02-f16d-424f-8c46-7bdc18f54569" (UID: "0e278c02-f16d-424f-8c46-7bdc18f54569"). InnerVolumeSpecName "kube-api-access-rtpkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:09:54.677132 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.677088    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e278c02-f16d-424f-8c46-7bdc18f54569-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:09:54.677132 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:54.677127    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtpkh\" (UniqueName: \"kubernetes.io/projected/0e278c02-f16d-424f-8c46-7bdc18f54569-kube-api-access-rtpkh\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:09:55.234806 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.234766    4958 generic.go:356] "Generic (PLEG): container finished" podID="0e278c02-f16d-424f-8c46-7bdc18f54569" containerID="632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578" exitCode=0
Oct 31 13:09:55.235304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.234834    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"
Oct 31 13:09:55.235304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.234848    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" event={"ID":"0e278c02-f16d-424f-8c46-7bdc18f54569","Type":"ContainerDied","Data":"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"}
Oct 31 13:09:55.235304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.234939    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth" event={"ID":"0e278c02-f16d-424f-8c46-7bdc18f54569","Type":"ContainerDied","Data":"b514b0da5148970272c1fee94b5be6a51ce8f6333b18d9fd40b60718885c882b"}
Oct 31 13:09:55.235304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.234964    4958 scope.go:122] "RemoveContainer" containerID="632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"
Oct 31 13:09:55.245363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.245346    4958 scope.go:122] "RemoveContainer" containerID="632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"
Oct 31 13:09:55.245666 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:09:55.245644    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578\": container with ID starting with 632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578 not found: ID does not exist" containerID="632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"
Oct 31 13:09:55.245715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.245675    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578"} err="failed to get container status \"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578\": rpc error: code = NotFound desc = could not find container \"632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578\": container with ID starting with 632a304206863877a34f1e4bcb65271a10cfe8db606636ad954fe46c139e2578 not found: ID does not exist"
Oct 31 13:09:55.260323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.260291    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:55.268215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.268179    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-6cf7bcbfb6-ksnth"]
Oct 31 13:09:55.898616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:55.898566    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:56.483005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:56.482962    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:56.490254 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:56.490224    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e278c02-f16d-424f-8c46-7bdc18f54569" path="/var/lib/kubelet/pods/0e278c02-f16d-424f-8c46-7bdc18f54569/volumes"
Oct 31 13:09:58.120948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:58.120912    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:58.282575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:58.282542    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:59.575361 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:09:59.575282    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:09:59.658520 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:59.658482    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:09:59.821579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:09:59.821537    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:20.794782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:20.794740    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:20.925399 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:20.925361    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:21.300491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:21.300451    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:21.447948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:21.447905    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:21.629887 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:21.629804    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:21.788166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:21.788123    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:21.933265 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:21.933162    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:22.083515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:22.083475    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:22.253619 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:22.253584    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:25.266730 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:25.266693    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:25.443774 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:25.443736    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:25.616166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:25.616074    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:25.766452 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:25.766411    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:25.933753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:25.933664    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:26.091310 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.091275    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:26.598082 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.598047    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:26.620160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.620121    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:10:26.620932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.620903    4958 cpu_manager.go:414] "containerMap: removing container" podUID="0e278c02-f16d-424f-8c46-7bdc18f54569" containerName="manager"
Oct 31 13:10:26.620932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.620931    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e278c02-f16d-424f-8c46-7bdc18f54569" containerName="manager"
Oct 31 13:10:26.621131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.621043    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e278c02-f16d-424f-8c46-7bdc18f54569" containerName="manager"
Oct 31 13:10:26.631162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.631124    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.640193 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.640163    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-426787\""
Oct 31 13:10:26.642246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.641571    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-426787-dockercfg-n64ft\""
Oct 31 13:10:26.649165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.649123    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:10:26.693221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.693170    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9t6v\" (UniqueName: \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.693431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.693304    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.750108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.750049    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:10:26.762471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.759098    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:26.777348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.777310    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:10:26.794442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.794401    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9t6v\" (UniqueName: \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.794644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.794485    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.795259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.795235    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.811127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.811094    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9t6v\" (UniqueName: \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\") pod \"payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.825475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.825434    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:26.867562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.867467    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:10:26.872404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.872369    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:26.879245 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.879160    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 13:10:26.879245 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.879176    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-426787-serving-cert\""
Oct 31 13:10:26.895806 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.895766    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7dlk\" (UniqueName: \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:26.895988 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.895879    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:26.903524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.903485    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:10:26.929726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.929675    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2hbvg\""
Oct 31 13:10:26.952434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.952401    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:26.996847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.996809    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7dlk\" (UniqueName: \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:26.997056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.996879    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:26.997056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.996915    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:26.997056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.996933    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpvgl\" (UniqueName: \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:26.997229 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.997056    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:26.997229 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.997089    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:26.997712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:26.997691    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:27.016773 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.016415    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:27.032421 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.032390    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7dlk\" (UniqueName: \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\") pod \"payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:27.082061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.082015    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:27.098891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.098854    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.099013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.098908    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpvgl\" (UniqueName: \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.099013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.098959    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.099013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.099004    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.099745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.099716    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.101457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.101428    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.101641 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.101584    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.114780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.114741    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpvgl\" (UniqueName: \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\") pod \"maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.174079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.174025    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:27.191206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.191125    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:27.246732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.246669    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:10:27.249818 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:27.249780    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d23592c_3c08_4562_bde6_895b1a25bedf.slice/crio-e11052781253b87f3e8d4ff8d0db8bc55416d69c7ca7babe99b28d387cf7dce2 WatchSource:0}: Error finding container e11052781253b87f3e8d4ff8d0db8bc55416d69c7ca7babe99b28d387cf7dce2: Status 404 returned error can't find the container with id e11052781253b87f3e8d4ff8d0db8bc55416d69c7ca7babe99b28d387cf7dce2
Oct 31 13:10:27.365059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.365032    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:10:27.366563 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:27.366527    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9fd0ca_bb43_49e0_bbf2_3006262effaf.slice/crio-4002000ecacbc7d9dfbd013aad5cfe8c82b353618eb08187c553cec1815138e3 WatchSource:0}: Error finding container 4002000ecacbc7d9dfbd013aad5cfe8c82b353618eb08187c553cec1815138e3: Status 404 returned error can't find the container with id 4002000ecacbc7d9dfbd013aad5cfe8c82b353618eb08187c553cec1815138e3
Oct 31 13:10:27.435567 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.435514    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" event={"ID":"2d23592c-3c08-4562-bde6-895b1a25bedf","Type":"ContainerStarted","Data":"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"}
Oct 31 13:10:27.435792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.435660    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" event={"ID":"2d23592c-3c08-4562-bde6-895b1a25bedf","Type":"ContainerStarted","Data":"e11052781253b87f3e8d4ff8d0db8bc55416d69c7ca7babe99b28d387cf7dce2"}
Oct 31 13:10:27.435792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.435704    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:27.437264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.437223    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" event={"ID":"fb9fd0ca-bb43-49e0-bbf2-3006262effaf","Type":"ContainerStarted","Data":"4002000ecacbc7d9dfbd013aad5cfe8c82b353618eb08187c553cec1815138e3"}
Oct 31 13:10:27.460756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.460700    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" podStartSLOduration=1.460682802 podStartE2EDuration="1.460682802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:27.457352319 +0000 UTC m=+649.120778042" watchObservedRunningTime="2026-10-31 13:10:27.460682802 +0000 UTC m=+649.124108487"
Oct 31 13:10:27.494072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.494039    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:10:27.495214 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:27.495186    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d26977_831b_4a07_a5b5_dad023202527.slice/crio-24c78fc14933c1e3225d2cdd1991f2c119e538f882534a7472d3f7c36f35d9ae WatchSource:0}: Error finding container 24c78fc14933c1e3225d2cdd1991f2c119e538f882534a7472d3f7c36f35d9ae: Status 404 returned error can't find the container with id 24c78fc14933c1e3225d2cdd1991f2c119e538f882534a7472d3f7c36f35d9ae
Oct 31 13:10:27.496696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.496677    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:10:27.522753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.522714    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:27.571873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.571822    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:10:27.576073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.576033    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.580652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.580623    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-f9e24f-dockercfg-7mgbs\""
Oct 31 13:10:27.588775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.588739    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:10:27.591779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.591742    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-f9e24f\""
Oct 31 13:10:27.613588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.613543    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:10:27.618414 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.618384    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.672024 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.661066    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:10:27.692259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.692186    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:27.707802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.707762    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4xd\" (UniqueName: \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.708090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.708067    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgn7\" (UniqueName: \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.708202 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.708153    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.708261 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.708198    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.809251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.809193    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgn7\" (UniqueName: \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.809467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.809308    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.809467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.809358    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.809467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.809442    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4xd\" (UniqueName: \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.812648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.811879    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.815686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.815463    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.836184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.836145    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4xd\" (UniqueName: \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\") pod \"payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:27.836526 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.836498    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgn7\" (UniqueName: \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\") pod \"payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.894887 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.894847    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:27.935543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:27.935441    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:28.200745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.200708    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:10:28.201904 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:28.201866    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac16359_9bac_4b04_926b_517e4bb611c6.slice/crio-4d73308d474b9115af7dee7ba515823e0c0df9d231616df136ac51fd87d023eb WatchSource:0}: Error finding container 4d73308d474b9115af7dee7ba515823e0c0df9d231616df136ac51fd87d023eb: Status 404 returned error can't find the container with id 4d73308d474b9115af7dee7ba515823e0c0df9d231616df136ac51fd87d023eb
Oct 31 13:10:28.208343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.208271    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:10:28.213892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.213866    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.240300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.240262    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:10:28.268733 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:28.267199    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f66737_e1d1_47d9_98b9_72e115fc780e.slice/crio-6ea3a0d3996b1ba14ed2ddcade3c2e3a4a26e1d0f49659bba12cf20baf3d6886 WatchSource:0}: Error finding container 6ea3a0d3996b1ba14ed2ddcade3c2e3a4a26e1d0f49659bba12cf20baf3d6886: Status 404 returned error can't find the container with id 6ea3a0d3996b1ba14ed2ddcade3c2e3a4a26e1d0f49659bba12cf20baf3d6886
Oct 31 13:10:28.291698 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.291668    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:10:28.313912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.313887    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-f9e24f-serving-cert\""
Oct 31 13:10:28.314294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.314265    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.314397 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.314331    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.314548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.314520    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.314648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.314583    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfwwp\" (UniqueName: \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.322395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.322365    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:28.415988 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.415938    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.416208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.416060    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.416208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.416092    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfwwp\" (UniqueName: \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.416208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.416202    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.416877 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.416852    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.419076 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.419040    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.419240 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.419100    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.432375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.432337    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfwwp\" (UniqueName: \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\") pod \"maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.447815 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.447728    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" event={"ID":"61d26977-831b-4a07-a5b5-dad023202527","Type":"ContainerStarted","Data":"2d52216caea4bd2d3d89e967f2643ae4bd3931e61757f2d2d59cb1ace4334be3"}
Oct 31 13:10:28.447815 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.447817    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:28.448090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.447840    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" event={"ID":"61d26977-831b-4a07-a5b5-dad023202527","Type":"ContainerStarted","Data":"24c78fc14933c1e3225d2cdd1991f2c119e538f882534a7472d3f7c36f35d9ae"}
Oct 31 13:10:28.450213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.450128    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" event={"ID":"86f66737-e1d1-47d9-98b9-72e115fc780e","Type":"ContainerStarted","Data":"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"}
Oct 31 13:10:28.450213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.450186    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" event={"ID":"86f66737-e1d1-47d9-98b9-72e115fc780e","Type":"ContainerStarted","Data":"6ea3a0d3996b1ba14ed2ddcade3c2e3a4a26e1d0f49659bba12cf20baf3d6886"}
Oct 31 13:10:28.450433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.450215    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:28.451915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.451887    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" event={"ID":"5ac16359-9bac-4b04-926b-517e4bb611c6","Type":"ContainerStarted","Data":"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"}
Oct 31 13:10:28.452068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.451934    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" event={"ID":"5ac16359-9bac-4b04-926b-517e4bb611c6","Type":"ContainerStarted","Data":"4d73308d474b9115af7dee7ba515823e0c0df9d231616df136ac51fd87d023eb"}
Oct 31 13:10:28.452068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.451957    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:28.453943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.453909    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" event={"ID":"fb9fd0ca-bb43-49e0-bbf2-3006262effaf","Type":"ContainerStarted","Data":"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"}
Oct 31 13:10:28.454093 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.453997    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:28.458229 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.458200    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:28.477280 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.477200    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" podStartSLOduration=2.037600956 podStartE2EDuration="2.477178946s" totalImagesPullingTime="439.57799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:28.472986374 +0000 UTC m=+650.136412074" watchObservedRunningTime="2026-10-31 13:10:28.477178946 +0000 UTC m=+650.140604728"
Oct 31 13:10:28.493522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.493467    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" podStartSLOduration=1.493451025 podStartE2EDuration="1.493451025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:28.493053947 +0000 UTC m=+650.156479635" watchObservedRunningTime="2026-10-31 13:10:28.493451025 +0000 UTC m=+650.156876712"
Oct 31 13:10:28.513945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.513877    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" podStartSLOduration=2.5138568770000003 podStartE2EDuration="2.513856877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:28.512331181 +0000 UTC m=+650.175756886" watchObservedRunningTime="2026-10-31 13:10:28.513856877 +0000 UTC m=+650.177282823"
Oct 31 13:10:28.536926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.536887    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:28.611767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.611712    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:28.735217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.735145    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" podStartSLOduration=1.735122127 podStartE2EDuration="1.735122127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:28.536915985 +0000 UTC m=+650.200341671" watchObservedRunningTime="2026-10-31 13:10:28.735122127 +0000 UTC m=+650.398547814"
Oct 31 13:10:28.739423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.739386    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:10:28.745739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.745704    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.755021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.754973    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:10:28.755705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.755579    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-7bf66c\""
Oct 31 13:10:28.759282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.758032    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-7bf66c-dockercfg-vnrtg\""
Oct 31 13:10:28.759476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.759450    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:10:28.763097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.763058    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:28.764375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.764349    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.782425 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.782146    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:10:28.832097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.829833    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.832097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.830006    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.832097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.830075    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kf7r\" (UniqueName: \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.832097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.830108    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmslp\" (UniqueName: \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.845506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.844695    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:10:28.931390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.931353    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.931588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.931438    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kf7r\" (UniqueName: \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.931588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.931471    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmslp\" (UniqueName: \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.931753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.931655    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.932328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.932282    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.932680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.932656    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.946639 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.946587    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmslp\" (UniqueName: \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\") pod \"payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:28.947834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.947807    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kf7r\" (UniqueName: \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\") pod \"payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:28.984431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:28.984394    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.066707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.066598    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:29.088868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.088767    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:29.156427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.156391    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.184430 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.184395    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:10:29.197035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.196994    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.201660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.201576    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:10:29.204394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.204367    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-a2c006-dockercfg-dwm67\""
Oct 31 13:10:29.229977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.229945    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:10:29.233777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.233748    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.247677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.247643    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:10:29.269754 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.269726    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-a2c006\""
Oct 31 13:10:29.305345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.304726    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.341028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.340992    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.341184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.341047    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.341254 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.341194    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6ww5\" (UniqueName: \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.341254 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.341246    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlj52\" (UniqueName: \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.367544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.367505    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:10:29.413719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.413685    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:10:29.416071 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:29.416035    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df344e9_34f5_4e4c_a5ed_ffd23ac7820a.slice/crio-d604f75c0f5e5c795dcfd29b82bf2405a96fe11c4a208d497a12bf6b50625657 WatchSource:0}: Error finding container d604f75c0f5e5c795dcfd29b82bf2405a96fe11c4a208d497a12bf6b50625657: Status 404 returned error can't find the container with id d604f75c0f5e5c795dcfd29b82bf2405a96fe11c4a208d497a12bf6b50625657
Oct 31 13:10:29.442367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.442325    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6ww5\" (UniqueName: \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.443687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.443089    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj52\" (UniqueName: \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.443687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.443269    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.443687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.443310    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.444437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.444407    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.444517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.444442    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.457158 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.457115    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6ww5\" (UniqueName: \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\") pod \"payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.457763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.457738    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlj52\" (UniqueName: \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\") pod \"payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.464414 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.464179    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" event={"ID":"9164fd1f-c692-449b-8fa3-51bf89b7d97a","Type":"ContainerStarted","Data":"6fb114626aef3ca61ed9a140f1592d5271241ad77b53e97ff0e500123ae28a56"}
Oct 31 13:10:29.466691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.466647    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" event={"ID":"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a","Type":"ContainerStarted","Data":"d604f75c0f5e5c795dcfd29b82bf2405a96fe11c4a208d497a12bf6b50625657"}
Oct 31 13:10:29.468564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.468532    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" event={"ID":"bd3683c7-fd58-47ea-a551-e3a341947f7a","Type":"ContainerStarted","Data":"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"}
Oct 31 13:10:29.468694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.468592    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" event={"ID":"bd3683c7-fd58-47ea-a551-e3a341947f7a","Type":"ContainerStarted","Data":"70c2ba46053cfe1bb3aef68cf039f3c909ffbfcab2ea37834561fe2546556489"}
Oct 31 13:10:29.469587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.469108    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:29.515814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.515773    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:29.552357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.552103    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:29.620938 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:10:29.620839    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:10:29.632276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.632175    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.655684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.655272    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" podStartSLOduration=1.273498063 podStartE2EDuration="1.655249201s" totalImagesPullingTime="381.751138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:29.492707444 +0000 UTC m=+651.156133156" watchObservedRunningTime="2026-10-31 13:10:29.655249201 +0000 UTC m=+651.318674887"
Oct 31 13:10:29.662306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.662268    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:10:29.682324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.670891    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.682324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.678375    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-2a262a-dockercfg-c774f\""
Oct 31 13:10:29.688842 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.687756    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-2a262a\""
Oct 31 13:10:29.690213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.690178    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:10:29.722788 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.722754    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:10:29.727930 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.727901    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.739719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.738796    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:10:29.756097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.753312    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.756097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.753386    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqsq\" (UniqueName: \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.792192 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.792156    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:10:29.799789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.799725    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.802784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.801746    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:10:29.802784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.801862    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:29.820440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.820398    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-7bf66c-serving-cert\""
Oct 31 13:10:29.854299 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.854265    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zn82\" (UniqueName: \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.854696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.854659    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.854860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.854843    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.855005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.854986    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqsq\" (UniqueName: \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.856486 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.856463    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.886506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.879861    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqsq\" (UniqueName: \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\") pod \"payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:29.896935 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:29.896897    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e3ef82_cab7_4a86_9377_d7f18fcb3b04.slice/crio-1343dc0f1047bbcee35b49eee4e23cf094e87b1b1991fc69e6ec7817d91e1a3d WatchSource:0}: Error finding container 1343dc0f1047bbcee35b49eee4e23cf094e87b1b1991fc69e6ec7817d91e1a3d: Status 404 returned error can't find the container with id 1343dc0f1047bbcee35b49eee4e23cf094e87b1b1991fc69e6ec7817d91e1a3d
Oct 31 13:10:29.897197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.896988    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:10:29.928558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.928521    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:10:29.941475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.941036    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:29.956312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956262    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2fhc\" (UniqueName: \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:29.956488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956332    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:29.956488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956366    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:29.956488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956425    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zn82\" (UniqueName: \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.956691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956540    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:29.956691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.956583    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.957501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.957468    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:29.972592 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:29.972567    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zn82\" (UniqueName: \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\") pod \"payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:30.005403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.005375    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:30.059673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.057866    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.059673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.057971    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2fhc\" (UniqueName: \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.059673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.058007    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.059673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.058045    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.059673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.059375    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.061491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.061447    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.064068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.062058    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.067213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.066961    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:30.077281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.077219    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2fhc\" (UniqueName: \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\") pod \"maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.098175 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.098104    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:30.167460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.166044    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:30.305162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.305109    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:10:30.307319 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:30.307282    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eeed622_73ae_4d52_9985_ea079cac05d9.slice/crio-cbefd3b3958766e1103527228eb0178c1127601e4acedb537525fafc8be644a5 WatchSource:0}: Error finding container cbefd3b3958766e1103527228eb0178c1127601e4acedb537525fafc8be644a5: Status 404 returned error can't find the container with id cbefd3b3958766e1103527228eb0178c1127601e4acedb537525fafc8be644a5
Oct 31 13:10:30.377268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.375788    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:10:30.377268 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:30.376460    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2169535_a6f1_4888_9ade_adf32976a82a.slice/crio-9d87c989dc465c8cf6f7dbfdd8d63c812ede9b9010f1edde29bfbdd38956c370 WatchSource:0}: Error finding container 9d87c989dc465c8cf6f7dbfdd8d63c812ede9b9010f1edde29bfbdd38956c370: Status 404 returned error can't find the container with id 9d87c989dc465c8cf6f7dbfdd8d63c812ede9b9010f1edde29bfbdd38956c370
Oct 31 13:10:30.483111 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.483081    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:30.520711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.520673    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:10:30.521005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.520977    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" event={"ID":"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04","Type":"ContainerStarted","Data":"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"}
Oct 31 13:10:30.521129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.521116    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" event={"ID":"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04","Type":"ContainerStarted","Data":"1343dc0f1047bbcee35b49eee4e23cf094e87b1b1991fc69e6ec7817d91e1a3d"}
Oct 31 13:10:30.525416 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.524591    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" event={"ID":"2fe0a300-d496-4950-9247-6a143646d313","Type":"ContainerStarted","Data":"c589084f6150c563f6fb8220bd7256ce3a3b7347c0d4abad02c1a1b08646c15d"}
Oct 31 13:10:30.525416 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.524703    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" event={"ID":"2fe0a300-d496-4950-9247-6a143646d313","Type":"ContainerStarted","Data":"f49791dc053c8a50704d518eb8b7b2127333167cd12c1804dbdc1856ea35c092"}
Oct 31 13:10:30.526703 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.526307    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:30.528392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.528287    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" event={"ID":"9eeed622-73ae-4d52-9985-ea079cac05d9","Type":"ContainerStarted","Data":"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"}
Oct 31 13:10:30.528392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.528346    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" event={"ID":"9eeed622-73ae-4d52-9985-ea079cac05d9","Type":"ContainerStarted","Data":"cbefd3b3958766e1103527228eb0178c1127601e4acedb537525fafc8be644a5"}
Oct 31 13:10:30.528616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.528518    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:30.530539 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.530505    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" event={"ID":"b2169535-a6f1-4888-9ade-adf32976a82a","Type":"ContainerStarted","Data":"b0e9aaeff09d38bddb1d6cf9b373f53a2c9ae0f1d17b2aeec4fa2f21dd2a81d4"}
Oct 31 13:10:30.530675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.530564    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" event={"ID":"b2169535-a6f1-4888-9ade-adf32976a82a","Type":"ContainerStarted","Data":"9d87c989dc465c8cf6f7dbfdd8d63c812ede9b9010f1edde29bfbdd38956c370"}
Oct 31 13:10:30.531236 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.531215    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:30.534377 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.534346    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" event={"ID":"9164fd1f-c692-449b-8fa3-51bf89b7d97a","Type":"ContainerStarted","Data":"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"}
Oct 31 13:10:30.534511 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.534420    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:30.537070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.537044    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" event={"ID":"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a","Type":"ContainerStarted","Data":"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"}
Oct 31 13:10:30.537388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.537369    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:30.561107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.561030    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" podStartSLOduration=1.561010921 podStartE2EDuration="1.561010921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.560467045 +0000 UTC m=+652.223892759" watchObservedRunningTime="2026-10-31 13:10:30.561010921 +0000 UTC m=+652.224436608"
Oct 31 13:10:30.596293 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.596227    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" podStartSLOduration=1.59620984 podStartE2EDuration="1.59620984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.593287986 +0000 UTC m=+652.256713670" watchObservedRunningTime="2026-10-31 13:10:30.59620984 +0000 UTC m=+652.259635526"
Oct 31 13:10:30.616112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.616051    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" podStartSLOduration=1.616031251 podStartE2EDuration="1.616031251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.613400143 +0000 UTC m=+652.276825846" watchObservedRunningTime="2026-10-31 13:10:30.616031251 +0000 UTC m=+652.279456935"
Oct 31 13:10:30.621910 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.621870    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:30.645423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.645306    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" podStartSLOduration=2.645288881 podStartE2EDuration="2.645288881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.636165137 +0000 UTC m=+652.299590836" watchObservedRunningTime="2026-10-31 13:10:30.645288881 +0000 UTC m=+652.308714565"
Oct 31 13:10:30.669974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.669890    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" podStartSLOduration=1.6698729239999999 podStartE2EDuration="1.669872924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.662798188 +0000 UTC m=+652.326223872" watchObservedRunningTime="2026-10-31 13:10:30.669872924 +0000 UTC m=+652.333298609"
Oct 31 13:10:30.700456 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.700395    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" podStartSLOduration=2.700378139 podStartE2EDuration="2.700378139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:30.698367002 +0000 UTC m=+652.361792689" watchObservedRunningTime="2026-10-31 13:10:30.700378139 +0000 UTC m=+652.363803833"
Oct 31 13:10:30.927580 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:30.927487    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:31.100911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.100866    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:31.323675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.323640    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:31.413937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.413902    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:10:31.418078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.418055    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.425565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.424751    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-79c6ff-dockercfg-2sjs6\""
Oct 31 13:10:31.431633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.429180    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:10:31.439180 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.439143    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-79c6ff\""
Oct 31 13:10:31.470112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.470071    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:31.547922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.547876    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" event={"ID":"8d8db944-8073-4ac0-9ef9-2b92bf766a3e","Type":"ContainerStarted","Data":"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"}
Oct 31 13:10:31.548124 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.547947    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" event={"ID":"8d8db944-8073-4ac0-9ef9-2b92bf766a3e","Type":"ContainerStarted","Data":"bcdb30c8f9e0d346836e082c959b15ec02c6629227613e2d9b52419613ff6d74"}
Oct 31 13:10:31.548311 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.548288    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:31.548676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.548650    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:31.571766 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.571706    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" podStartSLOduration=2.129518162 podStartE2EDuration="2.571687062s" totalImagesPullingTime="442.1689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:31.569858966 +0000 UTC m=+653.233284652" watchObservedRunningTime="2026-10-31 13:10:31.571687062 +0000 UTC m=+653.235112746"
Oct 31 13:10:31.589488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.589375    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.589488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.589447    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslxv\" (UniqueName: \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.692081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.691252    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.692081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.691410    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslxv\" (UniqueName: \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.692731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.692704    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.705278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.705243    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslxv\" (UniqueName: \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\") pod \"payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.742013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.741977    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:31.898209 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.898112    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:10:31.903917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.903886    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:31.913923 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.913882    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:10:31.916103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.915141    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-2a262a-serving-cert\""
Oct 31 13:10:31.989589 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.989555    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:31.997978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.997937    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:31.998173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.998064    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjvh\" (UniqueName: \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:31.998173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.998125    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:31.998173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:31.998170    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.040022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.039987    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:10:32.041643 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:32.041579    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35981ba1_2c78_41ef_a7ca_c16952d72669.slice/crio-6a015b027c4097d681424b525440a8fd20cbe3ed5df2f97a35f428d3311f2ddd WatchSource:0}: Error finding container 6a015b027c4097d681424b525440a8fd20cbe3ed5df2f97a35f428d3311f2ddd: Status 404 returned error can't find the container with id 6a015b027c4097d681424b525440a8fd20cbe3ed5df2f97a35f428d3311f2ddd
Oct 31 13:10:32.098811 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.098776    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.098977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.098840    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjvh\" (UniqueName: \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.098977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.098880    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.098977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.098916    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.099149 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:10:32.099012    4958 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-serving-cert: secret "maas-api-e2e-worker-w2-2a262a-serving-cert" not found
Oct 31 13:10:32.099149 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:10:32.099086    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls podName:a918740e-9f94-483b-8837-6ccd8ae2a6a0 nodeName:}" failed. No retries permitted until 2026-10-31 13:10:32.599065618 +0000 UTC m=+654.262491282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls") pod "maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" (UID: "a918740e-9f94-483b-8837-6ccd8ae2a6a0") : secret "maas-api-e2e-worker-w2-2a262a-serving-cert" not found
Oct 31 13:10:32.099564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.099545    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.101487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.101462    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.113127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.113096    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjvh\" (UniqueName: \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.130718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.130686    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:32.330338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.330294    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:32.556162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.556125    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" event={"ID":"35981ba1-2c78-41ef-a7ca-c16952d72669","Type":"ContainerStarted","Data":"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"}
Oct 31 13:10:32.556348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.556183    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" event={"ID":"35981ba1-2c78-41ef-a7ca-c16952d72669","Type":"ContainerStarted","Data":"6a015b027c4097d681424b525440a8fd20cbe3ed5df2f97a35f428d3311f2ddd"}
Oct 31 13:10:32.556658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.556634    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:32.576928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.576782    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" podStartSLOduration=1.5767669880000001 podStartE2EDuration="1.576766988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:32.576244247 +0000 UTC m=+654.239669933" watchObservedRunningTime="2026-10-31 13:10:32.576766988 +0000 UTC m=+654.240192673"
Oct 31 13:10:32.605195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.605089    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.608318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.608268    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") pod \"maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.832558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.832518    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:32.985046 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:32.984970    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:33.122436 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:33.122404    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:10:33.123560 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:10:33.123532    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda918740e_9f94_483b_8837_6ccd8ae2a6a0.slice/crio-214e93beb64e90c4890feb2ec5d0b8a879f1ded22948fd350e8b273c2e5266cb WatchSource:0}: Error finding container 214e93beb64e90c4890feb2ec5d0b8a879f1ded22948fd350e8b273c2e5266cb: Status 404 returned error can't find the container with id 214e93beb64e90c4890feb2ec5d0b8a879f1ded22948fd350e8b273c2e5266cb
Oct 31 13:10:33.565204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:33.565167    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" event={"ID":"a918740e-9f94-483b-8837-6ccd8ae2a6a0","Type":"ContainerStarted","Data":"214e93beb64e90c4890feb2ec5d0b8a879f1ded22948fd350e8b273c2e5266cb"}
Oct 31 13:10:33.902874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:33.902779    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:34.051550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.051517    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:34.475063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.475032    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:10:34.575650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.575584    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" event={"ID":"a918740e-9f94-483b-8837-6ccd8ae2a6a0","Type":"ContainerStarted","Data":"a83c571752b77a1646595332be8e9af57294726755eae620dafe6aad7c6d4d16"}
Oct 31 13:10:34.575840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.575690    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:34.600052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.599994    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" podStartSLOduration=3.218918688 podStartE2EDuration="3.599977374s" totalImagesPullingTime="381.058686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:10:34.596726453 +0000 UTC m=+656.260152140" watchObservedRunningTime="2026-10-31 13:10:34.599977374 +0000 UTC m=+656.263403064"
Oct 31 13:10:34.863685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:34.860506    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:35.079452 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:35.079408    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:36.085481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:36.085437    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:36.554523 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:36.554493    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:10:37.056598 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:37.056548    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:37.562957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:37.562926    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:10:38.082810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:38.082440    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:38.457544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:38.457519    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:10:39.069176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:39.069137    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:39.471812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:39.471765    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:10:39.472007 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:39.471992    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:10:39.472166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:39.472148    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:10:40.097541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:40.097509    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:40.293128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:40.293096    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:40.478365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:40.478314    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:40.593629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:40.590258    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:10:41.075209 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.075164    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:41.231948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.231914    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:41.516856 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.516813    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:41.551875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.551839    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:10:41.552295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.552268    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:10:41.552666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:41.552642    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:10:42.492359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:42.492330    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:42.559776 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:42.559742    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:10:42.559966 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:42.559953    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:10:42.560022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:42.559997    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:10:42.639179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:42.639141    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:43.311515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:43.311461    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:43.569929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:43.569843    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:10:43.860232 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:43.860142    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:44.107925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:44.107877    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:45.058457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:45.058426    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:45.434957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:45.434871    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:45.601418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:45.601383    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:45.905654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:45.905625    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:46.115345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:46.115311    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:46.288870 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:46.288807    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:46.462662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:46.462628    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:46.801726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:46.801692    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:46.996929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:46.996899    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:47.893797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:47.893763    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:48.611131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:48.611100    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:49.518727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:49.518688    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:50.755218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:50.755183    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:51.770273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:51.770235    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:52.821648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:52.821585    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:53.719818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:53.719779    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:54.527783 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:54.527737    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:55.411215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:55.411177    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:56.170376 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:56.170341    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:56.316273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:56.316242    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:56.821172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:56.821130    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:56.989210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:56.989170    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:57.139211 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:57.139116    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:57.287259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:57.287224    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:58.211441 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:58.211398    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:59.002784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:59.002747    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:59.474199 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:59.474168    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:10:59.585481 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:10:59.585383    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:10:59.883264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:10:59.883130    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:00.826136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:00.826099    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:01.594641 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:01.594585    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:02.457420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:02.457377    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:03.295593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:03.295555    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:04.104418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:04.104342    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:04.879101 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:04.879064    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:05.447223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:05.447184    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:05.688693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:05.688655    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:06.620126 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:06.620041    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:07.489308 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:07.489257    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:08.389304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:08.389251    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:08.555929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:08.555893    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:09.181189 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:09.181146    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:10.012534 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:10.012493    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:10.883213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:10.883169    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:11.685511 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:11.685461    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:12.281871 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:12.281809    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:12.570103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:12.570007    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:13.512684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:13.512628    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:14.302736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:14.302701    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:15.118569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:15.118510    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:15.901348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:15.901306    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:16.164996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:16.164909    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:16.877284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:16.877249    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:17.039636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:17.039583    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:17.838984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:17.838949    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:18.808759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:18.808718    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:19.591398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:19.591363    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:20.393616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:20.393568    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:21.193745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:21.193704    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:22.222136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:22.222091    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:23.204005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:23.203975    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:24.197902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:24.197830    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:24.711179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:24.711141    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:25.013037 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:25.012940    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:25.815763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:25.815726    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:26.698723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:26.698686    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:27.506823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:27.506745    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:28.282578 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:28.282546    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:29.065628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:29.065585    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:29.281890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:29.281850    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:29.575631 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:11:29.575580    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:11:30.296279 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.296244    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:30.606639 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.606521    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:11:30.611419 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.611391    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.619588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.619558    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a2c006\"/\"kube-root-ca.crt\""
Oct 31 13:11:30.619765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.619671    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a2c006\"/\"openshift-service-ca.crt\""
Oct 31 13:11:30.619765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.619690    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a2c006\"/\"premium-w1-a2c006-kserve-self-signed-certs\""
Oct 31 13:11:30.619881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.619768    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a2c006\"/\"default-dockercfg-5bvlg\""
Oct 31 13:11:30.624327 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.624303    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:11:30.671522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671483    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.671522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671530    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.671785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671552    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.671830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671786    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.671830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671814    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.671924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.671910    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tt9\" (UniqueName: \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.681172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.681131    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:30.772735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772694    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.772735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772737    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.772968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772755    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.772968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772809    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.772968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772827    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.772968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.772950    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tt9\" (UniqueName: \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.773214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.773187    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.773284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.773214    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.773343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.773290    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.775188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.775159    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.775402 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.775387    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.788373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.788344    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tt9\" (UniqueName: \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\") pod \"premium-w1-a2c006-kserve-79cf645d99-d5klc\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") " pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:30.927479 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:30.927377    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:31.229780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:31.229474    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:11:31.229780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:31.229705    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:31.230221 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:11:31.230183    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf52c40f_75af_4a67_8f9f_79fb782ff439.slice/crio-f379e1fd97d0b3fb622ff792120ee42ac65a2f2306d083999e666bff778bd242 WatchSource:0}: Error finding container f379e1fd97d0b3fb622ff792120ee42ac65a2f2306d083999e666bff778bd242: Status 404 returned error can't find the container with id f379e1fd97d0b3fb622ff792120ee42ac65a2f2306d083999e666bff778bd242
Oct 31 13:11:32.042629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.041626    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" event={"ID":"bf52c40f-75af-4a67-8f9f-79fb782ff439","Type":"ContainerStarted","Data":"0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046"}
Oct 31 13:11:32.042629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.041684    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" event={"ID":"bf52c40f-75af-4a67-8f9f-79fb782ff439","Type":"ContainerStarted","Data":"f379e1fd97d0b3fb622ff792120ee42ac65a2f2306d083999e666bff778bd242"}
Oct 31 13:11:32.066480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.066403    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podStartSLOduration=2.066382414 podStartE2EDuration="2.066382414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:11:32.062320577 +0000 UTC m=+713.725746255" watchObservedRunningTime="2026-10-31 13:11:32.066382414 +0000 UTC m=+713.729808101"
Oct 31 13:11:32.213964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.213927    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:32.567031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.566998    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:11:32.570882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.570855    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.587065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.587031    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:11:32.588125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.588099    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-004f64\"/\"premium-w3-004f64-kserve-self-signed-certs\""
Oct 31 13:11:32.588320 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.588208    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-004f64\"/\"default-dockercfg-qqb6j\""
Oct 31 13:11:32.602113 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.602059    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-004f64\"/\"openshift-service-ca.crt\""
Oct 31 13:11:32.602480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.602458    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-004f64\"/\"kube-root-ca.crt\""
Oct 31 13:11:32.650285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.650245    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:32.701980 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.701934    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzpll\" (UniqueName: \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.702176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.702124    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.702290 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.702266    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.702359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.702313    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.702359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.702348    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.702515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.702497    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804142    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804187    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804314    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804446    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804571    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzpll\" (UniqueName: \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804654    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804674    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804899 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804827    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.804996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.804974    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.806867 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.806841    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.807004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.806987    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.817992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.817938    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzpll\" (UniqueName: \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\") pod \"premium-w3-004f64-kserve-5c74d6cbc9-mqwl9\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") " pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.894449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.894406    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:32.927562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:32.927508    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:33.172323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:33.172245    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:33.194254 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:33.194218    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:11:33.776685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:33.776641    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:33.990023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:33.989985    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:34.056860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:34.056756    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" event={"ID":"f9940156-4289-4652-a1cc-29538fb10f5c","Type":"ContainerStarted","Data":"fab9d6c731b206c61fe87999ee8ec03f37fc8797de8b92954d7c7aa4e9d50269"}
Oct 31 13:11:34.056860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:34.056801    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" event={"ID":"f9940156-4289-4652-a1cc-29538fb10f5c","Type":"ContainerStarted","Data":"43b0ffc8278e6f8accd9aac365cf40f236ee266b8fcad100170782fb850b88a2"}
Oct 31 13:11:34.081049 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:34.080987    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podStartSLOduration=2.080971663 podStartE2EDuration="2.080971663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:11:34.077649576 +0000 UTC m=+715.741075283" watchObservedRunningTime="2026-10-31 13:11:34.080971663 +0000 UTC m=+715.744397379"
Oct 31 13:11:34.782721 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:34.782689    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:34.895178 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:34.895139    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:35.769491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:35.769459    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:36.625765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:36.625725    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:37.403676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:37.403642    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:38.390402 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:38.390357    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:39.194817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:39.194777    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:40.221260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:40.221203    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:40.928570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:40.928469    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:40.941965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:40.941926    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:41.123902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:41.123872    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:11:41.245636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:41.245574    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:42.332250 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:42.332213    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:42.894854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:42.894812    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:42.910011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:42.909980    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:43.143119 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:43.143087    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:11:43.447278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:43.447239    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:44.313023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:44.312979    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:45.375434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:45.375396    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:46.587333 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:46.587286    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:47.610391 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:47.610359    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:48.498423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:48.498385    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:49.271048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:49.271011    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:49.996339 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:49.996305    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:50.794336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:50.794302    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:51.607813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:51.607776    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:52.389743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:52.389707    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:53.193515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:53.193477    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:54.097620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:54.097575    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:54.869757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:54.869720    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:55.621390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:55.621353    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:56.504729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:56.504690    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:57.413166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:57.413119    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:58.385025 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:58.384981    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:59.305070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:11:59.305036    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:11:59.586231 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:11:59.586122    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:12:00.579418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:00.579375    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:01.410997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:01.410946    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:02.338278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:02.338241    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:03.126112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:03.126069    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:04.063026 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:04.062970    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:05.000132 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:05.000028    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:05.997901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:05.997855    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:06.817891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:06.817849    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:07.599875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:07.599827    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:08.433363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:08.433307    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:09.418742 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:09.418698    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:10.303294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:10.303255    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:11.292188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:11.292149    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:12.108195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:12.108151    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:12.919266 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:12.919213    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:13.878645 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:13.878586    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:14.758894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:14.758842    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:15.599204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:15.599158    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:16.483422 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:16.483381    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:17.358922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:17.358883    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:18.199517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:18.199487    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:19.044248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:19.044211    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:19.809427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:19.809391    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:20.612314 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:20.612271    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:21.568031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:21.568002    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:22.409438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:22.409389    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:23.321762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:23.321706    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:24.200952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:24.200911    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:25.329767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:25.329645    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:26.386312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:26.386279    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:27.454992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:27.454893    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:27.974951 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:27.974920    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:28.511147 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:28.511101    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:29.107552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.107514    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:29.242851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.242811    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:29.304426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.304384    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"]
Oct 31 13:12:29.309340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.309310    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.315152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.315122    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:12:29.315428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.315409    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:12:29.318812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.318550    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"]
Oct 31 13:12:29.401345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.401214    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:29.443969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.443922    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbz8r\" (UniqueName: \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.444187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.444044    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.444187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.444088    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.544781 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.544744    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbz8r\" (UniqueName: \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.545274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.544819    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.545274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.544855    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.545827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.545798    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.549371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.549339    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.565373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.565339    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbz8r\" (UniqueName: \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\") pod \"maas-api-revoke-sub-7fe862c2-lxt4v\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.579861 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:12:29.579817    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:12:29.628338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.628304    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:29.911819 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:29.911786    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"]
Oct 31 13:12:29.912582 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:12:29.912553    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d2cf1e_29d4_41f2_80b9_4c20eb49c6e1.slice/crio-76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae WatchSource:0}: Error finding container 76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae: Status 404 returned error can't find the container with id 76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae
Oct 31 13:12:30.196004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:30.195973    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:30.499763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:30.499716    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v" event={"ID":"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1","Type":"ContainerStarted","Data":"76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae"}
Oct 31 13:12:31.125271 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:31.125228    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:32.076543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:32.076461    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:33.169508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:33.169391    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:33.526762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:33.526720    4958 generic.go:356] "Generic (PLEG): container finished" podID="98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" containerID="7d9770c47112293f7dd0c7ba8a9b2f9e2d56c23f8543239b895528ed2ca7581d" exitCode=0
Oct 31 13:12:33.526958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:33.526839    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v" event={"ID":"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1","Type":"ContainerDied","Data":"7d9770c47112293f7dd0c7ba8a9b2f9e2d56c23f8543239b895528ed2ca7581d"}
Oct 31 13:12:34.095056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.095020    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:34.698764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.698739    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:34.704403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.704379    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\") pod \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") "
Oct 31 13:12:34.704559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.704432    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\") pod \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") "
Oct 31 13:12:34.704559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.704475    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\" (UniqueName: \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\") pod \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\" (UID: \"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1\") "
Oct 31 13:12:34.704860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.704828    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca" pod "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" (UID: "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:12:34.704995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.704927    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:12:34.706670 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.706640    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca" pod "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" (UID: "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:12:34.706892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.706862    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r" pod "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" (UID: "98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1"). InnerVolumeSpecName "kube-api-access-sbz8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:12:34.805654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.805530    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:12:34.805654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.805590    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbz8r\" (UniqueName: \"kubernetes.io/projected/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1-kube-api-access-sbz8r\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:12:34.999169 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:34.999133    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:35.543935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:35.543899    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v" event={"ID":"98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1","Type":"ContainerDied","Data":"76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae"}
Oct 31 13:12:35.543935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:35.543949    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76f5556d44db095257b31c7495245637bd62e58a970a8715abd374083596e5ae"
Oct 31 13:12:35.544201 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:35.543950    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"
Oct 31 13:12:36.020441 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.020403    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:36.580481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.580440    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:12:36.581159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.581132    4958 cpu_manager.go:414] "containerMap: removing container" podUID="98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" containerName="revoke-keys"
Oct 31 13:12:36.581275 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.581160    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" containerName="revoke-keys"
Oct 31 13:12:36.581334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.581296    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" containerName="revoke-keys"
Oct 31 13:12:36.585097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.585068    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.590755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.590731    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-426787-openshift-default-dockercfg-7cnrw\""
Oct 31 13:12:36.619892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.608156    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:12:36.723888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.723835    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.723905    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724025    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724203 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724131    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724203 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724176    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724237    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724261    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6k4g\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724289    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.724332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.724321    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825391 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825344    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825408    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825462    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825492    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825548    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825572    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6k4g\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825634    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825671    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.825884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.825768    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.826228 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.826194    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.826777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.826659    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.826777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.826700    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.827160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.826980    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.827160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.827118    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.828206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.828180    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.828572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.828556    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.841525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.841472    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6k4g\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.842775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.842752    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.922856 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.922821    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:36.975920 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:36.975883    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:37.245634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.235418    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:12:37.287875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.286079    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:37.287875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.286176    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:37.287875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.286229    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:37.599019 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.598913    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" event={"ID":"b81b9a5a-83a9-4477-bee5-a8b0c091f696","Type":"ContainerStarted","Data":"5ad7dea222a92991ed4e1e6a668c300155e49524a58f950b511c32221ef1b4b8"}
Oct 31 13:12:37.599019 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.598986    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" event={"ID":"b81b9a5a-83a9-4477-bee5-a8b0c091f696","Type":"ContainerStarted","Data":"ee0e23e1181a4e812b924d17d3ae876ed65ac925e44f7e3d99a63f9b17ac8af2"}
Oct 31 13:12:37.640629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.633585    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podStartSLOduration=1.633565267 podStartE2EDuration="1.633565267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:37.632951119 +0000 UTC m=+779.296376834" watchObservedRunningTime="2026-10-31 13:12:37.633565267 +0000 UTC m=+779.296990953"
Oct 31 13:12:37.923825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:37.923692    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:38.059631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:38.052823    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:38.940629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:38.928220    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:38.940629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:38.928290    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:39.250113 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:39.250031    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:39.941630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:39.940065    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:39.941630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:39.940146    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:40.217359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.217328    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:40.566700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.566447    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:12:40.571833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.571582    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:12:40.571833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.571716    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.584739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.584710    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-004f64\"/\"distinct-w3-004f64-kserve-self-signed-certs\""
Oct 31 13:12:40.586502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.586469    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:40.677903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.677850    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.677903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.677900    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.678176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.677934    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.678176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.677953    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.678176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.678033    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdb9n\" (UniqueName: \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.678176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.678072    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.733568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.733528    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:40.779594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779557    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.779789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779596    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.779789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779713    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdb9n\" (UniqueName: \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.779789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779767    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.779925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779844    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.779925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.779889    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.780178 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.780145    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.780344 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.780238    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.780344 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.780303    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.782251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.782219    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.782639 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.782599    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.793065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.792953    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdb9n\" (UniqueName: \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\") pod \"distinct-w3-004f64-kserve-5f8565b54-4mrwg\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") " pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.894575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.894476    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:40.960355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.960314    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:40.963631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:40.962379    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:41.258174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.257924    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:12:41.416411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.416013    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:41.681750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.681656    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" event={"ID":"cedd26c4-de10-4701-88ce-819467dd3c05","Type":"ContainerStarted","Data":"3826b1c11724273a4de7ef86089977494e2a7a693ce3e4e78111396970523ae5"}
Oct 31 13:12:41.681750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.681713    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" event={"ID":"cedd26c4-de10-4701-88ce-819467dd3c05","Type":"ContainerStarted","Data":"068235787f531fc663a55445ff8f3239c334e49e5a667d6616aeb2e8cb60f1a9"}
Oct 31 13:12:41.705821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.705768    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podStartSLOduration=1.7057512959999999 podStartE2EDuration="1.705751296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:41.703165157 +0000 UTC m=+783.366590862" watchObservedRunningTime="2026-10-31 13:12:41.705751296 +0000 UTC m=+783.369176980"
Oct 31 13:12:41.894814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.894775    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:41.941726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.935134    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:41.941726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:41.935222    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:42.531632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:42.527727    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:42.923951 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:42.923850    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:42.924234 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:42.924202    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:43.595690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:43.595654    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:43.924288 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:43.924189    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 13:12:43.924288 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:43.924265    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 13:12:44.524125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:44.524081    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:45.150599 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:45.150565    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:45.152192 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:45.152155    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:45.154442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:45.154417    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:12:45.697003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:45.696964    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:46.502075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:46.502037    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:47.393676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:47.393642    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:48.270871 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:48.270825    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:49.126192 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:49.126153    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:50.003281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:50.003249    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:50.888297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:50.888253    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:50.895014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:50.894977    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:50.915642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:50.915585    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:51.452948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.452908    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:12:51.462817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.462785    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.471772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.471731    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:12:51.476950 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.476918    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-f9e24f-openshift-default-dockercfg-xqbc5\""
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.507903    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.507986    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508025    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfxc\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508057    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508116    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508174    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508211    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508297    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.508594 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.508333    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616253    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616559    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfxc\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616681    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616781 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616761    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616838    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616914 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616884    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.616995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.616981    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.617054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.617021    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.617104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.617084    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.617514 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.617490    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.618371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.618342    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.618945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.618914    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.619586 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.619560    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.619839 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.619818    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.623878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.623829    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.624834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.624804    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.634429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.634401    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfxc\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.634645 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.633427    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.785011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.784974    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:12:51.785368 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.785348    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:51.930298 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.927971    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:51.984965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.984918    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:12:52.004632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:51.999566    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.007252 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.005691    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:12:52.011346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.011320    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-004f64-openshift-default-dockercfg-k4xnk\""
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038671    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038755    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzg9l\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038817    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038860    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038917    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.038974    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.039010    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.039073    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.040222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.039155    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.074512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.074471    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:12:52.113224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.111903    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.114757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.114715    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:12:52.121172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.121129    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7bf66c-openshift-default-dockercfg-htxtf\""
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.163323    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.163486    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.163586    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.163707    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.164249    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.164349    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzg9l\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165096    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165144    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165194    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165236    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165295    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165327    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165389    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165427    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165474    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165504    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rwd\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165553    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.165587    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.166117    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.166817    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.167598    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.168703    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.168975    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.183426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.169626    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.189653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.187423    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.189653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.187516    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.189653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.187572    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.191945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.191845    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:12:52.193329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.193300    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.195303 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.195247    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.196313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.196288    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzg9l\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.267460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267422    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267482    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267514    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rwd\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267558    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267636    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267681    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267713    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.267944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267752    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.269200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.267826    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.269200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.268793    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.269382 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.269205    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.269472 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.269446    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.269690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.269658    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.271369 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.271338    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.271971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.271924    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.272586 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.272544    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.284152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.284128    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.284901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.284875    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rwd\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.373888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.373582    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:52.497659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.497419    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:52.673966 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.673880    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:12:52.680287 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:12:52.680255    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c749dd_f9f6_438c_b8ef_1d628ff1bc32.slice/crio-ff3af59735ff3b48a79bfeef5263dd1eb989f17243fb5e03da37f0ffdc78a978 WatchSource:0}: Error finding container ff3af59735ff3b48a79bfeef5263dd1eb989f17243fb5e03da37f0ffdc78a978: Status 404 returned error can't find the container with id ff3af59735ff3b48a79bfeef5263dd1eb989f17243fb5e03da37f0ffdc78a978
Oct 31 13:12:52.682587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.682544    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.682737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.682662    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.682737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.682712    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.782782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.782751    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" event={"ID":"f86b4232-8744-4027-8186-5adb07edc9ce","Type":"ContainerStarted","Data":"d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52"}
Oct 31 13:12:52.782992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.782976    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" event={"ID":"f86b4232-8744-4027-8186-5adb07edc9ce","Type":"ContainerStarted","Data":"e8f99cac56a9e6580db26a499f728106a194cac0494ffb159fd77e2948162d48"}
Oct 31 13:12:52.784571 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.784540    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" event={"ID":"64c749dd-f9f6-438c-b8ef-1d628ff1bc32","Type":"ContainerStarted","Data":"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"}
Oct 31 13:12:52.784711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.784597    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" event={"ID":"64c749dd-f9f6-438c-b8ef-1d628ff1bc32","Type":"ContainerStarted","Data":"ff3af59735ff3b48a79bfeef5263dd1eb989f17243fb5e03da37f0ffdc78a978"}
Oct 31 13:12:52.785680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.785664    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:12:52.800819 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.800762    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:12:52.812785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.812391    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.812785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.812506    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.812785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.812561    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:52.876553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.876486    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podStartSLOduration=1.876467211 podStartE2EDuration="1.876467211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:52.810016523 +0000 UTC m=+794.473442220" watchObservedRunningTime="2026-10-31 13:12:52.876467211 +0000 UTC m=+794.539892899"
Oct 31 13:12:52.907545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:52.907463    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podStartSLOduration=1.907441723 podStartE2EDuration="1.907441723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:52.889031921 +0000 UTC m=+794.552457609" watchObservedRunningTime="2026-10-31 13:12:52.907441723 +0000 UTC m=+794.570867409"
Oct 31 13:12:53.014264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.014228    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:53.374663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.373972    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:12:53.375596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.375561    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:53.375756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.375631    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:53.793479 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.793430    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:53.794239 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.794211    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:53.804757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.804538    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" event={"ID":"6085accf-11b6-4de1-b73a-e251162abb34","Type":"ContainerStarted","Data":"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"}
Oct 31 13:12:53.804757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:53.804633    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" event={"ID":"6085accf-11b6-4de1-b73a-e251162abb34","Type":"ContainerStarted","Data":"f70a04f3ba25ba4d29a25e9e7051ecd157d558c5227aeae87ad941348d6e5675"}
Oct 31 13:12:54.215693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.199717    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:54.391632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.388058    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:54.391632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.388121    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:54.415177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.415140    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:54.514886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.514779    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:54.514886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.514854    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:54.590758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.590724    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:12:54.798690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.794988    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:54.798690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:54.795050    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:55.378059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.378015    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:55.378366 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.378332    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:55.503109 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.503046    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:55.503413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.503380    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:55.725699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.677188    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podStartSLOduration=3.677165988 podStartE2EDuration="3.677165988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:53.903062089 +0000 UTC m=+795.566487788" watchObservedRunningTime="2026-10-31 13:12:55.677165988 +0000 UTC m=+797.340591672"
Oct 31 13:12:55.794632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.789009    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:55.798648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.794878    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:55.822632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.797655    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"]
Oct 31 13:12:55.822632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.816100    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:55.918663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:55.917779    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"]
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078269    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078355    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078385    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078425    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078457    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078508    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078551    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97ae0c6b-03b6-483f-b261-b292222e09a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078671    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.109718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.078706    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9464\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-kube-api-access-h9464\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.145780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.137514    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:56.256569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.256533    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.257965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.257275    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.260824    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.260910    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.260964    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97ae0c6b-03b6-483f-b261-b292222e09a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.261097    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.261179    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9464\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-kube-api-access-h9464\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.261224    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.261308    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.261333    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.262027    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.265109    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.265407    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.265690    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97ae0c6b-03b6-483f-b261-b292222e09a8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.268642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.266257    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97ae0c6b-03b6-483f-b261-b292222e09a8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.297884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.297799    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.301100 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.301035    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9464\" (UniqueName: \"kubernetes.io/projected/97ae0c6b-03b6-483f-b261-b292222e09a8-kube-api-access-h9464\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.309291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.309225    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97ae0c6b-03b6-483f-b261-b292222e09a8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-ckhwx\" (UID: \"97ae0c6b-03b6-483f-b261-b292222e09a8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.375568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.375010    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:56.375568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.375075    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:56.502634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.498227    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:56.502634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.498284    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:56.586876 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.586834    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:56.789969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.789929    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:56.790247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:56.790219    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:57.403978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.402227    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:57.403978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.402293    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:57.534957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.513013    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:57.555399 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.555362    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:57.555655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.555624    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:57.593361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.593323    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"]
Oct 31 13:12:57.616499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.610482    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:57.616499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.610623    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:57.616499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.610726    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:12:57.789978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.789934    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:57.790279 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:57.790244    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:58.272626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.268917    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" event={"ID":"97ae0c6b-03b6-483f-b261-b292222e09a8","Type":"ContainerStarted","Data":"4eda584d6f0dc7d42cb121bf38cddee455567ff7279ab72c9548a8128968f26c"}
Oct 31 13:12:58.272626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.269032    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" event={"ID":"97ae0c6b-03b6-483f-b261-b292222e09a8","Type":"ContainerStarted","Data":"1a9287be6ea6cf630c9115964ddc4e813e8467862177de21ca41c53f90fc19c4"}
Oct 31 13:12:58.326632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.320357    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podStartSLOduration=3.320334849 podStartE2EDuration="3.320334849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:12:58.311752695 +0000 UTC m=+799.975178423" watchObservedRunningTime="2026-10-31 13:12:58.320334849 +0000 UTC m=+799.983760535"
Oct 31 13:12:58.401118 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.401030    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:58.401118 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.401084    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:58.511776 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.510990    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:58.511776 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.511062    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:58.642636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.639690    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:12:58.788243 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.788196    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:12:58.788570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:58.788513    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:12:59.003863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.003816    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:12:59.374631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.374030    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:12:59.374631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.374095    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:12:59.503629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.503082    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:12:59.503629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.503192    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:12:59.599394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.597777    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:12:59.599394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:12:59.597846    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:12:59.647686 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:12:59.644849    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:13:00.315426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.315331    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:13:00.316892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.316860    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:13:00.317822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.317795    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:13:00.374281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.374242    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 13:13:00.374490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.374292    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 13:13:00.492756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.492701    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:00.499183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.497993    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 13:13:00.499440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.499413    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 13:13:00.593987 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.593893    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:00.594231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:00.594201    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:01.380079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.380041    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:13:01.380628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.380449    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:13:01.381496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.381474    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:13:01.455358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.455316    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:01.503429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.503393    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:13:01.504384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.504359    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:13:01.505239 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.505190    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:13:01.588971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.588933    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:01.589284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:01.589253    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:02.432241 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:02.432199    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:02.588377 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:02.588343    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:02.588564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:02.588400    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:03.298247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:03.298192    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:03.588568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:03.588476    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:03.588568 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:03.588541    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:04.334317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:04.334276    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:04.588159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:04.588074    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:04.588159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:04.588133    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:04.717030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:04.716994    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:05.419429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:05.419353    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:05.587782 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:05.587747    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 13:13:05.588056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:05.588026    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 13:13:05.739022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:05.738960    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:06.417206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.417173    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:06.709398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.709353    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:13:06.714684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.714654    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.724261 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.724232    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-2a262a-openshift-default-dockercfg-bjmvk\""
Oct 31 13:13:06.738304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.738268    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:13:06.816381 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816327    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816396    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816514    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816549    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816643    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816695    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816817    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jdg\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816862    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.816958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.816912    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.917901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.917853    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.918247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918219    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jdg\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.918444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918426    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.918579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918559    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.918734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918717    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.918891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918874    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919033    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919135    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919241    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919397 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919381    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919581 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919394    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.919736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.919681    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.920008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.918911    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.920872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.920810    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.922771 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.922723    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.924041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.924006    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.934372 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.934288    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jdg\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.937022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.936380    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:13:06.943755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.943717    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:06.944954 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.944927    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:06.954977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.954943    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:13:06.973543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.973454    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-79c6ff-openshift-default-dockercfg-tkwch\""
Oct 31 13:13:06.984520 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:06.984446    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:07.021100 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021056    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021148    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021202    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021271    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021300    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wp8b\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021387    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021442    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021494    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.021555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.021523    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.051631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.047909    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124379    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124480    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124517    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124580    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124625    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wp8b\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124702    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124749    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124791    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.124817    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.138629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.136396    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.139305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.139253    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.144858 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.139696    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.154701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.150174    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.154701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.150522    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.154701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.152093    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.154701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.152157    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.154701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.154126    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.163659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.163634    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wp8b\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.296733 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.296640    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:07.417013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.416839    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:13:07.432669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.432136    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.432669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.432223    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.432669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.432265    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.590506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.588708    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:13:07.590506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.588778    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:13:07.615938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.615902    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:13:07.616176 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:07.616025    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7cdee4_3ef1_473a_a921_394ff5ff947f.slice/crio-2e421dbdd37559294cb7c6aa705c97c2a43cc7a40985dcbf084b7f36c26c2c7e WatchSource:0}: Error finding container 2e421dbdd37559294cb7c6aa705c97c2a43cc7a40985dcbf084b7f36c26c2c7e: Status 404 returned error can't find the container with id 2e421dbdd37559294cb7c6aa705c97c2a43cc7a40985dcbf084b7f36c26c2c7e
Oct 31 13:13:07.620997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.620412    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.620997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.620500    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.620997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.620579    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:07.678363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.678332    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:13:07.679809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.679786    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:13:07.681784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.680802    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx"
Oct 31 13:13:07.692043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:07.692020    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:08.428634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.425050    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" event={"ID":"4c7cdee4-3ef1-473a-a921-394ff5ff947f","Type":"ContainerStarted","Data":"4d99cd730794e799021141f0e13679f7231de8669d5cc5d788213a82a310e6c3"}
Oct 31 13:13:08.428634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.425176    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" event={"ID":"4c7cdee4-3ef1-473a-a921-394ff5ff947f","Type":"ContainerStarted","Data":"2e421dbdd37559294cb7c6aa705c97c2a43cc7a40985dcbf084b7f36c26c2c7e"}
Oct 31 13:13:08.461629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.456820    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" event={"ID":"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796","Type":"ContainerStarted","Data":"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"}
Oct 31 13:13:08.461629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.456911    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" event={"ID":"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796","Type":"ContainerStarted","Data":"1a1eda27bce2201369be1b8ebb7f19f25c9179cbab2b5f8c358fe8b0509600ce"}
Oct 31 13:13:08.476671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.472898    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podStartSLOduration=2.472876694 podStartE2EDuration="2.472876694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:08.466071151 +0000 UTC m=+810.129496882" watchObservedRunningTime="2026-10-31 13:13:08.472876694 +0000 UTC m=+810.136302404"
Oct 31 13:13:08.515644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.514909    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podStartSLOduration=2.514885256 podStartE2EDuration="2.514885256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:08.50308321 +0000 UTC m=+810.166508934" watchObservedRunningTime="2026-10-31 13:13:08.514885256 +0000 UTC m=+810.178310942"
Oct 31 13:13:08.722682 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:08.718323    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:09.062684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.061981    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:09.062684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.062198    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:09.062684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.062253    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:09.299917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.299714    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:09.300137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.299996    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:09.300137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:09.300051    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:10.054148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:10.054112    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:10.054805 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:10.054754    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:10.158093 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:10.157418    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:10.305692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:10.303062    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:10.305692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:10.303134    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:11.087630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:11.073073    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:11.087630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:11.073142    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:11.321627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:11.303864    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:11.321627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:11.303929    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:12.055628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:12.054978    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:12.055628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:12.055055    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:12.077714 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:12.077674    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:12.297146 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:12.297105    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:12.297575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:12.297183    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:13.057066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:13.057022    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:13.057365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:13.057330    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:13.281494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:13.281446    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:13.297384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:13.297345    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:13.297903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:13.297408    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:14.049038 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.048996    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 13:13:14.049365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.049326    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 13:13:14.296992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.296790    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:14.297167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.297014    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 13:13:14.297167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.297065    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 13:13:14.492196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:14.492160    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:15.495514 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:15.495474    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:15.934156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:15.934060    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:15.935672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:15.935401    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:15.936057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:15.936039    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:13:16.302447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.302408    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:13:16.302717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.302482    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:13:16.383701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.383665    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:16.384490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.384465    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:16.385095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.385074    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:13:16.400831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:16.400805    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:17.219174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:17.219132    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:18.026503 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:18.026457    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:18.905565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:18.905519    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:19.336505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.336467    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:13:19.342366 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.342336    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.349026 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.348967    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-79c6ff\"/\"kube-root-ca.crt\""
Oct 31 13:13:19.349026 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.348981    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-79c6ff\"/\"openshift-service-ca.crt\""
Oct 31 13:13:19.349267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.349073    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-79c6ff\"/\"default-dockercfg-rkkdq\""
Oct 31 13:13:19.361015 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.360982    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:13:19.413956 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.413918    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:19.445508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445458    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756kj\" (UniqueName: \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.445715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445593    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.445778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445721    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.445778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445756    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.445885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445866    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.445933 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.445919    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.447778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.447755    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-79c6ff\"/\"distinct-w6-79c6ff-kserve-self-signed-certs\""
Oct 31 13:13:19.547462 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547419    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.547672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547480    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.547672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547551    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-756kj\" (UniqueName: \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.547672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547587    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.547872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547673    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.547872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.547694    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.548257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.548222    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.548410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.548359    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.548486 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.548439    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.550596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.550562    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.550976 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.550952    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.563719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.563660    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-756kj\" (UniqueName: \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\") pod \"distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") " pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.665081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.664983    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:19.960636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.960571    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:19.972916 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:19.972885    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:13:19.973184 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:19.973136    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4156a27d_ce6a_4017_8487_df830915cc9d.slice/crio-fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161 WatchSource:0}: Error finding container fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161: Status 404 returned error can't find the container with id fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161
Oct 31 13:13:20.752493 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:20.752457    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" event={"ID":"4156a27d-ce6a-4017-8487-df830915cc9d","Type":"ContainerStarted","Data":"7838f20360f0bc8712161a0e3fb0db590a433bdcdb5bc38e6dcda6601bb5b487"}
Oct 31 13:13:20.752741 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:20.752507    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" event={"ID":"4156a27d-ce6a-4017-8487-df830915cc9d","Type":"ContainerStarted","Data":"fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161"}
Oct 31 13:13:20.775950 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:20.775897    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podStartSLOduration=1.775881738 podStartE2EDuration="1.775881738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:20.773495587 +0000 UTC m=+822.436921521" watchObservedRunningTime="2026-10-31 13:13:20.775881738 +0000 UTC m=+822.439307423"
Oct 31 13:13:20.808750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:20.808717    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:21.665087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:21.665038    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:21.774000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:21.773966    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:22.916631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:22.916522    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:24.125106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:24.123726    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:13:24.144787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:24.143729    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:13:24.309725 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:24.309556    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:25.320528 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:25.320484    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:26.342660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:26.342581    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:27.272696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:27.271779    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:28.111942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:28.111897    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:29.036152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.036115    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:29.181534 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.181492    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:29.580141 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:13:29.580096    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:13:29.665719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.665677    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:29.679841 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.679809    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:29.812775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.812737    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:29.881714 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.881631    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:13:29.930557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.930522    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:13:29.936070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.936036    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.943990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.943966    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-f9e24f\"/\"default-dockercfg-fs68n\""
Oct 31 13:13:29.944201 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.944090    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-f9e24f\"/\"openshift-service-ca.crt\""
Oct 31 13:13:29.944357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.944186    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-f9e24f\"/\"distinct-2-w5-f9e24f-kserve-self-signed-certs\""
Oct 31 13:13:29.951838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.948233    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:13:29.964874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.964839    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.965035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.964890    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.965035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.964907    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.965150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.965037    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.965150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.965101    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9wcv\" (UniqueName: \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:29.965150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:29.965129    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.021892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.021853    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:30.041030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.040996    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-f9e24f\"/\"kube-root-ca.crt\""
Oct 31 13:13:30.066037 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.065999    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066061    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9wcv\" (UniqueName: \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066081    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066124    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066152    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066172    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066542    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066579    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.066718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.066657    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.068541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.068518    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.069034 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.069012    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.082943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.082911    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9wcv\" (UniqueName: \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\") pod \"distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") " pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.262037 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.261994    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:30.564247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.564212    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:13:30.564466 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:30.564442    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab70d256_8f3f_4cc5_acde_8085b20c0e1a.slice/crio-49b7796ac8463b61d4da90715f5ce7b6769e4ff8b2daf71c54b8df623ec7e8d8 WatchSource:0}: Error finding container 49b7796ac8463b61d4da90715f5ce7b6769e4ff8b2daf71c54b8df623ec7e8d8: Status 404 returned error can't find the container with id 49b7796ac8463b61d4da90715f5ce7b6769e4ff8b2daf71c54b8df623ec7e8d8
Oct 31 13:13:30.742388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.742326    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:30.869119 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.869023    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" event={"ID":"ab70d256-8f3f-4cc5-acde-8085b20c0e1a","Type":"ContainerStarted","Data":"3a5e474572873cfa4909676924148fa1f486f8bbdf16e53c7afc20789c4c71b2"}
Oct 31 13:13:30.869119 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.869083    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" event={"ID":"ab70d256-8f3f-4cc5-acde-8085b20c0e1a","Type":"ContainerStarted","Data":"49b7796ac8463b61d4da90715f5ce7b6769e4ff8b2daf71c54b8df623ec7e8d8"}
Oct 31 13:13:30.890715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:30.890081    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podStartSLOduration=1.8900632499999999 podStartE2EDuration="1.89006325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:30.889719711 +0000 UTC m=+832.553145431" watchObservedRunningTime="2026-10-31 13:13:30.89006325 +0000 UTC m=+832.553488938"
Oct 31 13:13:31.262240 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:31.262201    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:31.534875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:31.534782    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:32.328267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:32.328231    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:33.218625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:33.218560    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:34.292482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:34.287698    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:35.079059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.079017    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:35.448540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.448450    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:13:35.453410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.453379    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.459315 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.459286    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 13:13:35.459485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.459353    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 13:13:35.459485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.459360    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kc68z\""
Oct 31 13:13:35.459485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.459420    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 13:13:35.472960 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.472930    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:13:35.530327 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530291    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530327 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530328    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530546 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530344    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530584 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530551    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5ls\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530600    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530649    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.530803 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.530789    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632269 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632199    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632269 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632263    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632286    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632413    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5ls\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632487    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632534    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.632732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.632722    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.634121 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.634090    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.635550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.635525    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.635726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.635704    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.635784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.635764    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.635826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.635814    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.647325 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.647294    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5ls\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.648878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.648849    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5dfxt\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.768877 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.768828    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:35.949669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:35.944908    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:36.074538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.074486    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:13:36.075982 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:36.075951    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5535bbe4_b2fe_4d46_b691_949a68e470e7.slice/crio-d62c17ca6bba9151ae903c615375c694bc385328e9c79d1fdc028f34e4c19cd4 WatchSource:0}: Error finding container d62c17ca6bba9151ae903c615375c694bc385328e9c79d1fdc028f34e4c19cd4: Status 404 returned error can't find the container with id d62c17ca6bba9151ae903c615375c694bc385328e9c79d1fdc028f34e4c19cd4
Oct 31 13:13:36.573407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.573366    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:13:36.580738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.580709    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.598845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.598815    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:13:36.647629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.640856    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.652963    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653028    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653098    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljcgp\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653125    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653165    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653246    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653311    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653356    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.659644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.653429    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.721595 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.720769    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:13:36.728780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.728323    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.752771 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.752737    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:13:36.755704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.754952    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.755973 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.755941    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756026    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756061    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756216 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756108    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756216 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756170    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756216 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756202    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756223    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756251    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756298    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756344    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756367    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756444    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljcgp\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756466    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756492    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756515    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756541    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm77b\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.756671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.756579    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.757625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.755239    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.757625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.757308    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.757625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.757561    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.761653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.758372    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.762080 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.759489    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.778921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.778882    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.780453 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.780425    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.781484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.781456    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.782174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.782151    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljcgp\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.858053 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.857939    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.858053 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.858010    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.858282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.858056    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.858645 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.858599    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.858860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.858665    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.858995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.858929    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859008    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859052 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859034    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859151 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859058    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm77b\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859209 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859167    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859246    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859248    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.859465 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.859448    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.860272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.860246    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.863777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.860988    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.873099 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.873074    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.875043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.875017    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.876385 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.876337    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm77b\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:36.907353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.907315    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:36.917522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:36.917485    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" event={"ID":"5535bbe4-b2fe-4d46-b691-949a68e470e7","Type":"ContainerStarted","Data":"d62c17ca6bba9151ae903c615375c694bc385328e9c79d1fdc028f34e4c19cd4"}
Oct 31 13:13:37.053650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.053489    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:37.178068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.178032    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:37.237033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.237002    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:13:37.239270 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:37.239235    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c6e028_102a_45a8_81c1_4fff8c6a3704.slice/crio-fcb359f8e2d663a65db7abfb6c251cc46a77c7f2a6ff2b9d754410feb2f300de WatchSource:0}: Error finding container fcb359f8e2d663a65db7abfb6c251cc46a77c7f2a6ff2b9d754410feb2f300de: Status 404 returned error can't find the container with id fcb359f8e2d663a65db7abfb6c251cc46a77c7f2a6ff2b9d754410feb2f300de
Oct 31 13:13:37.242539 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.242499    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.242663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.242589    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.242663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.242651    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.358641 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.358027    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:13:37.361461 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:37.361416    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228b0819_9f58_4ea0_8020_361205000f2a.slice/crio-2322783c3cac2bdba3edba296093b9c7dc1b2fa6c95f5b1857cb72498a2b5c19 WatchSource:0}: Error finding container 2322783c3cac2bdba3edba296093b9c7dc1b2fa6c95f5b1857cb72498a2b5c19: Status 404 returned error can't find the container with id 2322783c3cac2bdba3edba296093b9c7dc1b2fa6c95f5b1857cb72498a2b5c19
Oct 31 13:13:37.365945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.365899    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.366092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.366006    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.366092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.366057    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:37.966407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.966369    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" event={"ID":"228b0819-9f58-4ea0-8020-361205000f2a","Type":"ContainerStarted","Data":"326e7b3903c6f9b74bfb0b5a6002f4663c97b4f4b54af6c488bf78d1d7dd631c"}
Oct 31 13:13:37.967043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.967016    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" event={"ID":"228b0819-9f58-4ea0-8020-361205000f2a","Type":"ContainerStarted","Data":"2322783c3cac2bdba3edba296093b9c7dc1b2fa6c95f5b1857cb72498a2b5c19"}
Oct 31 13:13:37.969392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.969366    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" event={"ID":"86c6e028-102a-45a8-81c1-4fff8c6a3704","Type":"ContainerStarted","Data":"448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8"}
Oct 31 13:13:37.969583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.969568    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" event={"ID":"86c6e028-102a-45a8-81c1-4fff8c6a3704","Type":"ContainerStarted","Data":"fcb359f8e2d663a65db7abfb6c251cc46a77c7f2a6ff2b9d754410feb2f300de"}
Oct 31 13:13:37.997353 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:37.997298    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podStartSLOduration=1.997281399 podStartE2EDuration="1.997281399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:37.991912364 +0000 UTC m=+839.655338068" watchObservedRunningTime="2026-10-31 13:13:37.997281399 +0000 UTC m=+839.660707084"
Oct 31 13:13:38.017368 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.017306    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podStartSLOduration=2.017286618 podStartE2EDuration="2.017286618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:38.015256517 +0000 UTC m=+839.678682203" watchObservedRunningTime="2026-10-31 13:13:38.017286618 +0000 UTC m=+839.680712304"
Oct 31 13:13:38.056637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.053956    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:38.060853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.060817    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:38.061028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.060891    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:38.246691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.246256    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:38.908244 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.908153    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:38.909369 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.909340    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:38.909788 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:38.909761    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:39.055056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.055017    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:39.055672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.055630    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:39.398738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.398701    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:39.586697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.586568    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:39.908842 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.908803    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:39.909014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:39.908859    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:40.061628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.061276    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:40.061628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.061367    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:40.281827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.280784    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:40.297449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.297408    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:40.495942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.495853    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:40.908011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.907968    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:40.908172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:40.908034    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:41.074631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.059040    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:41.074631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.059102    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:41.088034 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.088002    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:13:41.612372 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.612330    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:41.907866 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.907771    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:41.907866 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:41.907850    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:42.086078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:42.086031    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:42.086570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:42.086089    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:42.615557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:42.615526    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:42.908972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:42.908898    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:42.908972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:42.908943    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:43.073630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.073518    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:43.073630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.073580    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:43.294167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.293316    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:43.800970 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.800937    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:43.801119 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.801016    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:43.803940 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.803910    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:43.909015 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.907727    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:13:43.909015 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:43.907783    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:13:44.054059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.053961    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 13:13:44.054059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.054025    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 13:13:44.111274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.111220    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" event={"ID":"5535bbe4-b2fe-4d46-b691-949a68e470e7","Type":"ContainerStarted","Data":"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"}
Oct 31 13:13:44.111447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.111295    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:44.113050 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.113021    4958 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-5dfxt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:13:44.113220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.113073    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:13:44.140324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.140266    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" podStartSLOduration=1.418960553 podStartE2EDuration="9.140251496s" totalImagesPullingTime="7.721290943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:44.136506947 +0000 UTC m=+845.799932689" watchObservedRunningTime="2026-10-31 13:13:44.140251496 +0000 UTC m=+845.803677180"
Oct 31 13:13:44.682224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.681242    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:44.900216 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:44.900179    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:45.010350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.010307    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:45.012182 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.012017    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:45.012403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.012383    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:13:45.059354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.059316    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:45.059800 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.059774    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:45.064471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.064441    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:13:45.168658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.167422    4958 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-5dfxt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:13:45.168658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.167480    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:13:45.927357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:45.927323    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:47.051634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:47.050908    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:48.167980 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:48.167945    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:13:48.545571 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:48.545478    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:49.527950 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:49.527911    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:50.283821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:50.283790    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:51.195183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:51.195138    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:52.039181 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.039139    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:52.132485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.132450    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:13:52.139512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.139482    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.150949 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.150914    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:13:52.186843 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.186809    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.186878    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.186953    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187027    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187128 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187095    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187125    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187261    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187316    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfjw\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.187439 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.187422    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.237214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.237150    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:13:52.242704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.242653    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.283874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.283817    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:13:52.289039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289012    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289066    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289094    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289115    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289166    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289189    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289531 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289278    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289531 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289325    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289531 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289422    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289531 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289489    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289541    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289593    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfjw\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289649    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.289786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289678    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n75n\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.289786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289758    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.290028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289864    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.290028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289904    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.290028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.289930    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.290384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.290360    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.291233 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.291210    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.291459 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.291433    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.292292 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.292265    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.292398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.292311    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.294457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.294402    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.298667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.298642    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.304300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.304270    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.304941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.304919    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfjw\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.391248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391198    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391264    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391302    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391360    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391416    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n75n\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391479    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391576    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391619    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391664    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391833    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.391971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391935    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.392027 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.391994    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.392106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.392082    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.392375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.392356    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.393792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.393765    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.394005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.393989    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.405240 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.405210    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.405460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.405434    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n75n\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.467426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.467387    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:52.582916 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.582832    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:52.769163 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:52.769121    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0154ebc_3756_4828_8d26_91a23b33455d.slice/crio-3521743a6e48499188a189b13b379dbb910ab69e5e56a12032bcacbc57da1dc0 WatchSource:0}: Error finding container 3521743a6e48499188a189b13b379dbb910ab69e5e56a12032bcacbc57da1dc0: Status 404 returned error can't find the container with id 3521743a6e48499188a189b13b379dbb910ab69e5e56a12032bcacbc57da1dc0
Oct 31 13:13:52.769678 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.769648    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:13:52.772011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.771975    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.772091 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.772056    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.772129 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.772098    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.883235 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.883206    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:13:52.883404 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:13:52.883380    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8067a1b9_57a7_4cf7_b287_74646d2fb036.slice/crio-18422a7d69ccb2745e3752ba813ce53f75d2475e694bb0f0f422552ada3d4b23 WatchSource:0}: Error finding container 18422a7d69ccb2745e3752ba813ce53f75d2475e694bb0f0f422552ada3d4b23: Status 404 returned error can't find the container with id 18422a7d69ccb2745e3752ba813ce53f75d2475e694bb0f0f422552ada3d4b23
Oct 31 13:13:52.886328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.886295    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.886429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.886360    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.886429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.886386    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:13:52.906765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:52.903890    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:53.281695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.281645    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" event={"ID":"8067a1b9-57a7-4cf7-b287-74646d2fb036","Type":"ContainerStarted","Data":"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"}
Oct 31 13:13:53.282202 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.281712    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" event={"ID":"8067a1b9-57a7-4cf7-b287-74646d2fb036","Type":"ContainerStarted","Data":"18422a7d69ccb2745e3752ba813ce53f75d2475e694bb0f0f422552ada3d4b23"}
Oct 31 13:13:53.283702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.283667    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" event={"ID":"c0154ebc-3756-4828-8d26-91a23b33455d","Type":"ContainerStarted","Data":"8e8d493a69235c3bc41fcf505c9723e3f74672bd81b3e63f025278916cdd50b1"}
Oct 31 13:13:53.283837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.283725    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" event={"ID":"c0154ebc-3756-4828-8d26-91a23b33455d","Type":"ContainerStarted","Data":"3521743a6e48499188a189b13b379dbb910ab69e5e56a12032bcacbc57da1dc0"}
Oct 31 13:13:53.323350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.323268    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podStartSLOduration=1.323243554 podStartE2EDuration="1.323243554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:53.30505365 +0000 UTC m=+854.968479334" watchObservedRunningTime="2026-10-31 13:13:53.323243554 +0000 UTC m=+854.986669240"
Oct 31 13:13:53.357954 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.357894    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podStartSLOduration=1.357875687 podStartE2EDuration="1.357875687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:13:53.351527982 +0000 UTC m=+855.014953665" watchObservedRunningTime="2026-10-31 13:13:53.357875687 +0000 UTC m=+855.021301372"
Oct 31 13:13:53.467923 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.467778    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:13:53.469577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.469527    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:53.469727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.469616    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:53.584988 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.584900    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:13:53.588104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.588069    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:53.588242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:53.588131    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:54.102966 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:54.102928    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:54.469634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:54.468220    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:54.469634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:54.468283    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:54.584156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:54.584116    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:54.584349 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:54.584192    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:55.179857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:55.179818    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:55.468653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:55.468043    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:55.468653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:55.468105    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:55.583280 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:55.583240    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:55.583736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:55.583300    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:56.479662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:56.478990    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:56.479662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:56.479059    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:56.507089 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:56.507013    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:56.591636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:56.591224    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:56.591636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:56.591309    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:57.475167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:57.470970    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:57.475167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:57.471033    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:57.583719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:57.583670    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:57.583902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:57.583737    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:57.696274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:57.696233    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:58.492668 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:58.492594    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:58.492952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:58.492918    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:58.583499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:58.583463    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:58.583794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:58.583759    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:58.830835 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:58.830732    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:59.468629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.468532    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 13:13:59.468843 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.468634    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 13:13:59.579218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.579089    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:13:59.583622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.583179    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 13:13:59.583622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.583244    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 13:13:59.606876 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:13:59.606800    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:13:59.997574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:13:59.997532    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:00.589036 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.589005    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:14:00.589765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.589729    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:14:00.590679 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.590656    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:14:00.624440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.624411    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:14:00.625309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.625286    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:14:00.628464 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:00.626357    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:14:01.108862 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:01.108831    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:02.050010 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:02.049970    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:02.823311 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:02.823243    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:03.796565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:03.796521    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:04.588067 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:04.588028    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:05.417450 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:05.417421    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:06.333655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:06.333615    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:07.067922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.067882    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:14:07.074136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.074108    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.090028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.089994    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:14:07.104820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.104780    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:14:07.110379 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.110352    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.129512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.129177    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:14:07.162093 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162061    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:14:07.162373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162344    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.162468 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162397    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.162468 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162434    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.162468 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162458    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162483    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162567    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxwk\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162598    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162640    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162702    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.162857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162754    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qd9\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.162857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162813    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.162857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162850    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.163039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162888    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.163039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162926    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.163039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.162992    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.163039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.163027    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.163287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.163053    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.163287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.163076    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.167011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.166989    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.180953 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.180922    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:14:07.228335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.228302    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:07.264545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264510    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264554    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264583    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264645    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264694    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264728    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264755    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264808    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxwk\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.264847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264837    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264866    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264896    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.264964    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265023    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qd9\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265072    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsbjw\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265115    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265161    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265208    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265251    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265293    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265363    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265398    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265440    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265470    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265497    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265521    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265645    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.265824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.265681    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.266666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.266225    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.267287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.267266    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.268135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.268061    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.268135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.268122    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.268650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.268568    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.269558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.269165    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.269558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.269229    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.269558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.269458    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.269558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.269527    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.270488 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.270466    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.273729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.273421    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.274494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.274466    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.275307 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.275283    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.275864 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.275839    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.284455 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.284429    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.284731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.284709    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.284891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.284864    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qd9\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.285059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.285041    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxwk\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\") pod \"e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") " pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.367260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367163    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367219    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367268    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367334    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367366    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367392    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367439    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367559    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsbjw\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367631    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367771    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.367825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.367804    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.368278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.368061    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.368278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.368066    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.368506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.368475    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.370100 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.370074    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.370335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.370314    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.382735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.382689    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.382937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.382916    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsbjw\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\") pod \"e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") " pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.396675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.396643    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:07.442478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.442433    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:07.499529 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.499497    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:07.703498 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.703454    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.703613 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.703551    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.703680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.703596    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.708185 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.708062    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:14:07.768471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.768435    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:14:07.772647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.772560    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.772760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.772661    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.772760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.772702    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.840173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.840123    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:14:07.852222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.852181    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.852338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.852271    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:07.852338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:07.852314    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:08.233644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.233179    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:08.493600 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493520    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" event={"ID":"c5d5dac2-f0e0-4948-b200-b72440b16930","Type":"ContainerStarted","Data":"341f1a3a04ca18a69378cb90cda415824e6c0e6bed9b6cc2e747cef54b801725"}
Oct 31 13:14:08.493600 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493571    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" event={"ID":"c5d5dac2-f0e0-4948-b200-b72440b16930","Type":"ContainerStarted","Data":"bde9a40f8300d7c3526b328b54b5895de0e25a204ed9daf283da5626a81cd9b8"}
Oct 31 13:14:08.493600 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493589    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" event={"ID":"a621e490-a4d4-4b69-9870-aff6bdad4b56","Type":"ContainerStarted","Data":"535f20bb2afb44fd5f08dc26c29f4cf633d76e322ca6828441285c5d2b39290d"}
Oct 31 13:14:08.494069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493622    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" event={"ID":"a621e490-a4d4-4b69-9870-aff6bdad4b56","Type":"ContainerStarted","Data":"f45f7664df36eeb157d6f19c888c32f91fa56084a47de85c8ef0c157c2dbcbe1"}
Oct 31 13:14:08.494069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493642    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" event={"ID":"3d796daa-8bc1-481c-87e1-9ef86af9dbfd","Type":"ContainerStarted","Data":"d4fefed1c5a3d83280f540d109fca2943dfc38c12dd8308dc76ddd51150cf82e"}
Oct 31 13:14:08.494069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.493659    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" event={"ID":"3d796daa-8bc1-481c-87e1-9ef86af9dbfd","Type":"ContainerStarted","Data":"cf94855deb67ce3660ff7a321e4e5e9ed27a38182ca66b96ce75318be5f523c6"}
Oct 31 13:14:08.500022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.499995    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:08.501545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.501520    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:08.501691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.501565    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:08.587817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.587749    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podStartSLOduration=1.587731732 podStartE2EDuration="1.587731732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:08.586285149 +0000 UTC m=+870.249710861" watchObservedRunningTime="2026-10-31 13:14:08.587731732 +0000 UTC m=+870.251157417"
Oct 31 13:14:08.631043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.630975    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podStartSLOduration=1.6309512050000001 podStartE2EDuration="1.630951205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:08.622166813 +0000 UTC m=+870.285592527" watchObservedRunningTime="2026-10-31 13:14:08.630951205 +0000 UTC m=+870.294376891"
Oct 31 13:14:08.679895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:08.679833    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podStartSLOduration=1.679815826 podStartE2EDuration="1.679815826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:08.675952008 +0000 UTC m=+870.339377710" watchObservedRunningTime="2026-10-31 13:14:08.679815826 +0000 UTC m=+870.343241508"
Oct 31 13:14:09.402631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.402421    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:09.402631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.402572    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:09.402903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.402639    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:09.447629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.447550    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:09.447813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.447721    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:09.447813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.447772    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:09.512633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.507083    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:09.512633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.507150    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:09.732205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:09.732156    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:10.428974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.422955    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:10.428974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.423037    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:10.486030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.485988    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:10.555631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.555285    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:10.555631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.501053    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:10.555631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.555488    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:10.861630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:10.861497    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:11.167693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.149427    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:11.376628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.376246    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:11.400632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.397542    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:11.400632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.397650    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:11.447689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.447198    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:11.447689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.447277    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:11.501671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.500802    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:11.501671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.500874    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:11.778631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.777956    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:11.861769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.861664    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:11.863968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.862792    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:11.901476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.901427    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:11.928361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:11.928304    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:12.032432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.032339    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:12.182637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.164817    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:12.194642 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.184369    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:12.454688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.454510    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:12.454688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.454579    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:12.610631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.506814    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:12.610631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.506879    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:12.610631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.530271    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:12.610631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.530346    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:12.865454 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.836878    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:13.003632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:12.868855    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 31 13:14:13.060497 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.060451    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:13.120059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.119961    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:13.243632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.191729    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:13.278509 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.278473    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:13.278809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.278792    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:14:13.506631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.503000    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:13.536628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.533338    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:13.734081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.503400    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:13.802807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.802697    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:13.803403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.533261    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:13.803669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.803645    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:13.852330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.852289    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.016658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:13.992857    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.020035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.017699    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.104341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.104240    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.199745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.199677    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.266872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.266821    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:14.295850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.295810    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:14:14.543924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.543879    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:14.572671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.547678    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:14.636669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.573234    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:14.637033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.636991    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:14.662722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.582574    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:14.702747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.702700    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:14.856084 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:14.855937    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:15.035629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.034707    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:15.144692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.136199    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:15.212629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.206881    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:15.315840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.315771    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:15.426460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.426338    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:15.426898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.426703    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:15.457224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.457165    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:15.465793 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.465748    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:15.557093 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.557060    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:15.557407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.557381    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:15.866629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.858348    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:15.877679 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:15.877537    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:16.049715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.045370    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.086755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.077718    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:16.086755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.077790    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.118857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.118750    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:16.118857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.118822    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.145630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.138887    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.235757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.235704    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.284643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.278727    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:16.292654 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.284881    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.359631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.355697    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.434686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.429899    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:16.434686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.429964    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:16.435778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.434996    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:16.435778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.435055    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.491553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.462822    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:16.491553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.462877    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:16.534625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.501432    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:16.534828 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.534699    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:16.934630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.904917    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:16.982114 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.981721    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:16.982114 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:16.981792    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:17.082629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.053154    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:17.165575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.146765    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:17.255799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.255747    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:17.375634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.359191    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:17.472748 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.472704    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:17.473018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.472975    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:17.487853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.487628    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:17.488113 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.488075    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:17.501251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.501188    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:17.503004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.502961    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:17.515826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.515740    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:17.775694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.769099    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:14:18.004628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.984781    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:18.004628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:17.984862    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:18.364714 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.364662    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:18.404082 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.404044    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:18.411762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.411719    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:18.487770 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.487715    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:18.489003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.488960    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:18.510047 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.509999    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:18.510328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.510293    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:18.727664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:18.726894    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:19.096100 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.093752    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:19.297306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.286329    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:14:19.422713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.422593    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 13:14:19.443721 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.443414    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 13:14:19.451244 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.451210    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 13:14:19.451494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.451463    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 13:14:19.500634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.500338    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 13:14:19.500634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.500404    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 13:14:19.708424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.708390    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:19.846107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:19.846072    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:20.980629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:20.980486    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:21.364012 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.363664    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:21.364854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.364818    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:21.369499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.369467    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:14:21.408803 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.408764    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:21.409083 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.409049    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:21.454848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.454804    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:21.455157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:21.455115    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:22.156470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.156430    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:22.396973 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.396910    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:22.454704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.442536    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:22.455231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.453598    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:22.455511 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.455480    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:22.497786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.497747    4958 patch_prober.go:29] interesting pod/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:22.498125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.498089    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:22.737655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.734516    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:22.739038 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.738985    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:14:22.886499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.886462    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:22.888439 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:22.888411    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:14:23.400628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:23.396906    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:24.370195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:24.370151    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:25.219300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:25.219227    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:26.274804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:26.274755    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:27.304060 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:27.304022    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:28.196880 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:28.196826    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:29.094883 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:29.094844    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:29.242300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:29.242262    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:29.581478 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:14:29.581437    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:14:29.988418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:29.987661    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:30.936275 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:30.936187    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:31.657105 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:31.657064    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:31.801429 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:31.801387    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:32.706312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:32.706279    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:33.510929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:33.504935    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:34.379310 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:34.379115    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:35.413702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:35.413663    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:36.422368 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.422271    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:36.701707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.701598    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:14:36.708673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.708645    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.723399 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.723364    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:14:36.747618 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.747574    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.747790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.747710    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4s8\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.747860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.747846    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.747990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.747973    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.748058 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.748005    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.748058 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.748039    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.748167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.748145    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.748208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.748180    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.748409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.748392    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.837904 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.837853    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:14:36.843935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.843905    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.849946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.849913    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.850195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850176    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.850309 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850296    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.850433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850420    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.850541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850525    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.851371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.851349    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.851732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.851711    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.851873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.851859    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.851985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.851971    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4s8\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.852406 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850661    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.852528 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.851214    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.852751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.852723    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.855127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.855106    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.855247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.850372    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.858518 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.857982    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.864965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.863375    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.876804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.876770    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:14:36.877361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.877333    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.877588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.877567    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4s8\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\") pod \"e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") " pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:36.929791 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.926475    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:14:36.943980 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.943944    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:36.953323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953228    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953272    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953301    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953413    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953452    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pl4\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953478    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953532    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.953588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953566    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.954434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.953619    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:36.955436 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.955409    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:14:36.995350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.995315    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:14:36.999997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:36.999973    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.008672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.008647    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-a2c006-openshift-default-dockercfg-shg42\""
Oct 31 13:14:37.024880 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.024845    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:14:37.036508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.036245    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055153    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055230    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055269    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055339    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055372    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055442    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055478    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055530    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055582    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055664    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055694    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055745    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055809    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055845    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055870    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055901    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055939    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.055990    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056024    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056070    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsn5x\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056102    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxr4\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056228    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056262    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056340    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pl4\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056369    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056401    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.059112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.056455    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.060928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.059644    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.060928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.060282    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.060928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.060560    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.061080 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.060938    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.063480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.061160    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.063480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.063287    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.064734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.064346    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.078256 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.078198    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.079206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.079173    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pl4\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\") pod \"e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") " pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.159743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.158541    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.159743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.158622    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.159743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.158683    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.159743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.158717    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169305    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169522    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169589    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169671    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169702    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169756    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169817    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169873    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169921    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.169957    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170002    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsn5x\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170036    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxr4\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170122    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170143    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170177    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170472    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170762    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.170964    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.171818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.171797    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.172971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.172085    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.172971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.172084    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.172971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.172280    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.172971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.172329    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.172971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.172421    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.175898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.175844    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.178684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.178654    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.180173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.180128    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.180274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.180226    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.189466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.189170    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.189466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.189170    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.189466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.189413    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxr4\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\") pod \"e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") " pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.189902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.189841    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsn5x\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.209968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.209758    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:37.265512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.265479    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:37.316400 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.316196    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:37.348830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.347106    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:14:37.371681 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.362274    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.387487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.380756    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:14:37.387487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.387408    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:14:37.402198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.401532    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.402198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.401684    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.402198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.401737    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.482115 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482080    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9v4\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482141    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482196    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482217    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482266    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482310    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482329    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482352    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.482473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.482456    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.550669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.538714    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:37.558679 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:14:37.558565    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b0dc49_dc42_41a6_b363_15cedf50afaa.slice/crio-033fbc1eb8dcf1633200719069d5826b932ce92574ff4e908f4093055e3009a2 WatchSource:0}: Error finding container 033fbc1eb8dcf1633200719069d5826b932ce92574ff4e908f4093055e3009a2: Status 404 returned error can't find the container with id 033fbc1eb8dcf1633200719069d5826b932ce92574ff4e908f4093055e3009a2
Oct 31 13:14:37.578205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.576517    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.578205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.576636    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.578205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.576685    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.578672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.578599    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.583644    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9v4\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.583714    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.583819    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.583849    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.583935    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.584002    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.584032    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.584061    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.588447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.584232    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.594137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.590882    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.594137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.591308    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.594137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.591587    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.594137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.592630    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.594137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.593276    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.595188 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.595166    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.599237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.599190    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.600505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.600484    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9v4\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.606837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.606811    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\") pod \"e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") " pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.623415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.623036    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:14:37.630648 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:14:37.630577    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0ccd25_8f64_4eda_b8b8_0a8ac88b6335.slice/crio-1d5ddce51f1c7b45a9455175fb1f298440ec4542b54391eb4c732b641357ad89 WatchSource:0}: Error finding container 1d5ddce51f1c7b45a9455175fb1f298440ec4542b54391eb4c732b641357ad89: Status 404 returned error can't find the container with id 1d5ddce51f1c7b45a9455175fb1f298440ec4542b54391eb4c732b641357ad89
Oct 31 13:14:37.687313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.687265    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.687501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.687387    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.687501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.687432    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.697389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.697267    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:14:37.698675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.698637    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" event={"ID":"72b0dc49-dc42-41a6-b363-15cedf50afaa","Type":"ContainerStarted","Data":"033fbc1eb8dcf1633200719069d5826b932ce92574ff4e908f4093055e3009a2"}
Oct 31 13:14:37.700068 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:14:37.700017    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1593a303_7a9f_48b8_a063_faafeed228a8.slice/crio-cc28cceab0ec89915c040154ad2c3a84823b4c3964a7b998076244c5f4bd5685 WatchSource:0}: Error finding container cc28cceab0ec89915c040154ad2c3a84823b4c3964a7b998076244c5f4bd5685: Status 404 returned error can't find the container with id cc28cceab0ec89915c040154ad2c3a84823b4c3964a7b998076244c5f4bd5685
Oct 31 13:14:37.701858 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.701760    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" event={"ID":"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335","Type":"ContainerStarted","Data":"1d5ddce51f1c7b45a9455175fb1f298440ec4542b54391eb4c732b641357ad89"}
Oct 31 13:14:37.705205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.705098    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" event={"ID":"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da","Type":"ContainerStarted","Data":"19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd"}
Oct 31 13:14:37.705443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.705383    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" event={"ID":"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da","Type":"ContainerStarted","Data":"7c6f39c05db2c5250a8a804abd11857de15e69997a69364bea610189746a67a8"}
Oct 31 13:14:37.712464 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.712432    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.712573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.712500    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.712573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.712530    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:37.718390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.718353    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:37.743742 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:37.743685    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podStartSLOduration=1.743664999 podStartE2EDuration="1.743664999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:37.729996388 +0000 UTC m=+899.393422099" watchObservedRunningTime="2026-10-31 13:14:37.743664999 +0000 UTC m=+899.407090682"
Oct 31 13:14:38.039000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.037330    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:38.039000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.038644    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:38.039000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.038717    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:38.167122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.167076    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:14:38.192299 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.192257    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:38.192432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.192350    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:38.192432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.192392    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:14:38.725743 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.710104    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:38.889807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.889672    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" event={"ID":"72b0dc49-dc42-41a6-b363-15cedf50afaa","Type":"ContainerStarted","Data":"adb2ac61fdf79451e47b30985f6689b77308f0ef7ef13c20313e214a0aac66ef"}
Oct 31 13:14:38.999685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:38.993950    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" event={"ID":"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335","Type":"ContainerStarted","Data":"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"}
Oct 31 13:14:39.072631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.035006    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podStartSLOduration=3.034982517 podStartE2EDuration="3.034982517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:38.938857538 +0000 UTC m=+900.602283227" watchObservedRunningTime="2026-10-31 13:14:39.034982517 +0000 UTC m=+900.698408203"
Oct 31 13:14:39.095718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.095681    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:39.096022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.095993    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:39.107268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.107223    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" event={"ID":"1593a303-7a9f-48b8-a063-faafeed228a8","Type":"ContainerStarted","Data":"bf98354219e9d9299684f8598f11c012deca5fa64223ce3cb3b080a2b9269ada"}
Oct 31 13:14:39.107512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.107490    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" event={"ID":"1593a303-7a9f-48b8-a063-faafeed228a8","Type":"ContainerStarted","Data":"cc28cceab0ec89915c040154ad2c3a84823b4c3964a7b998076244c5f4bd5685"}
Oct 31 13:14:39.157337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.157297    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" event={"ID":"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0","Type":"ContainerStarted","Data":"535f2e68c865266a5718ced9792c5218758db7459cc2fa5afa58c2654142cedf"}
Oct 31 13:14:39.174941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.174900    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" event={"ID":"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0","Type":"ContainerStarted","Data":"c1491de79b56dd33f4e3fa4172c8886ee9ae6f2ac07df6091bed7818c0081cf5"}
Oct 31 13:14:39.217704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.217669    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:39.261881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.261781    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:39.261881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.261846    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:39.262101 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.261828    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podStartSLOduration=3.261811019 podStartE2EDuration="3.261811019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:39.15455015 +0000 UTC m=+900.817975835" watchObservedRunningTime="2026-10-31 13:14:39.261811019 +0000 UTC m=+900.925236707"
Oct 31 13:14:39.264288 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.264233    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podStartSLOduration=3.264216597 podStartE2EDuration="3.264216597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:39.095255998 +0000 UTC m=+900.758681679" watchObservedRunningTime="2026-10-31 13:14:39.264216597 +0000 UTC m=+900.927642281"
Oct 31 13:14:39.266056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.266033    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:39.281432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.281396    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:39.281709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.281681    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:39.343717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.324068    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podStartSLOduration=2.324051015 podStartE2EDuration="2.324051015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:14:39.193795696 +0000 UTC m=+900.857221404" watchObservedRunningTime="2026-10-31 13:14:39.324051015 +0000 UTC m=+900.987476699"
Oct 31 13:14:39.343717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.340081    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:39.356793 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.356748    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:39.356991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.356813    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:39.380631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.378702    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:14:39.881643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.862400    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:39.925661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.911756    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:39.925661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:39.911820    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:40.039762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.036507    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:40.039762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.039046    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:40.039762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.039096    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:40.063167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.063131    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:14:40.065225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.065181    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:14:40.202162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.202019    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:40.218638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.214364    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:40.218638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.214434    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:40.218638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.215691    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:40.240632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.237097    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:14:40.273631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.270735    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:40.273631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.270799    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:40.335005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.334966    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:40.341048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.341011    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:40.341242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.341073    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:40.360520 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.360479    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:40.425628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.417760    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:40.745631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.725307    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:40.745631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.725380    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:40.847748 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:40.847699    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:41.059691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.053093    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:41.059691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.055489    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:41.090787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.090747    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:41.104820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.104770    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.672665    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.679590    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.683768    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.691934    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.692272    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:41.706316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.703940    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/health\": context deadline exceeded"
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816342    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816428    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816563    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816598    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816698    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:41.854672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.816729    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:41.970879 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:41.958650    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": context deadline exceeded"
Oct 31 13:14:42.018853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.018796    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:42.084489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.084446    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:14:42.378051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.327228    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:42.378051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.327907    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:14:42.525644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.517528    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:42.525644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.517672    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:42.590301 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.590251    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:42.700120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.700013    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:42.871633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.860101    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:42.897124 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.888560    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:42.964685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.955957    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:42.964685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.956037    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:42.964685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.956685    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:42.964685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.956737    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:42.964685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.957921    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.987574    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.987670    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.987831    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:42.987857    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.034218    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.066873    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.155762 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.066949    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:43.215708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.212038    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.215708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.212108    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:43.329628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.300310    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.329995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.329954    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:43.402632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.380414    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.402632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.380492    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:43.500689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.496988    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:43.592630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.592181    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:43.673637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.672816    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:43.730763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.730714    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:43.746626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.731311    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:43.746626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.739257    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:43.915179 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.915083    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:43.928636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.928564    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:43.950506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:43.932866    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:44.053640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.046587    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:44.053640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.046664    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:44.176683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.176088    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:44.176683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.176190    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:44.177244 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.176844    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:44.231112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.224307    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:44.231112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.224374    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:44.308631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.297359    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:44.308631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.297424    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:44.337632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.331326    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:44.337632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.331390    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:44.664689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.621629    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 31 13:14:44.740911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.740872    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:44.765632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.741175    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:44.828636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.771257    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:44.828853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.783750    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:44.939946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:44.938198    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:45.043427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.043379    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:45.043715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.043671    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:45.189468 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.189420    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:45.245443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.245406    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:45.245763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.245730    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:45.276640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.269052    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:45.276934 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.276897    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:45.415643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.403469    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:45.415643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.403544    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:45.697686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.646184    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:45.778632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.777821    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:45.778632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.777886    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:45.783926 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.783897    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:45.918070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.918020    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:45.963680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.918974    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:45.985014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:45.984973    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:46.155627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.154654    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:46.155627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.154721    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:46.204758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.204704    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:46.217838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.217744    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:46.218080 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.218049    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:46.348776 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.348735    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:46.358732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.358682    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:46.451629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.443844    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:46.451629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.443902    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:46.551255 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.551160    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:46.721266 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.721231    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:46.724224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.724171    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:46.953797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.953682    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:46.990863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.990813    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:46.999724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:46.992307    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:47.011148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.001027    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:47.066042 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.066003    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:47.066336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.066285    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:47.245633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.216107    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.282839    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.285880    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.285936    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.236216    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.324537    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:47.352630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.324973    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:47.620721 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.614705    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:47.728634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.727352    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:47.728634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:47.727437    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:48.018836 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.018779    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:48.068652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.019561    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:48.068652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.061822    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:48.135633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.120454    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:48.159080 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.159015    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:48.220831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.220784    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:48.221097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.221065    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:48.275735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.275624    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:48.276347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.276312    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:48.428032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.427991    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:48.449287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.449249    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:48.452629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.449511    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:48.619502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.619405    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:48.780631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.730428    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:48.966027 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:48.965983    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:49.047646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.045793    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:49.047646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.045854    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:49.074632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.073865    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:49.205630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.191354    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:49.205630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.191654    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:49.205630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.191853    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:49.280831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.280202    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:49.280831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.280266    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:49.328075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.328038    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:49.328349 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.328316    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:49.329476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.329450    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:49.338906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.335170    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:49.431422 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.431377    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:49.772750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.772714    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:49.788744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.788696    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:49.789380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:49.775852    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 31 13:14:50.132688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.126246    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:50.132688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.126310    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:50.212628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.206841    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:50.212628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.210923    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:50.223641 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.206763    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:50.433693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.408054    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:50.496676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.463233    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:50.571271 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.461582    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:50.571532 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.571501    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:50.571726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.560394    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:50.642633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.613120    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:50.642633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.619224    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:50.810627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.796700    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:50.810627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.796839    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:50.810627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.797963    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:50.810627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:50.798012    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:51.046570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.046525    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:51.047941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.047850    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:51.076898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.076804    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:51.207194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.207151    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:51.211735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.211691    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:51.216632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.212916    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:51.218701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.218667    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:51.222628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.218912    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:51.264756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.264703    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:51.267008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.266976    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:51.267234 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.267208    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:51.318097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.318054    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:51.318408 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.318365    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:51.572840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.572756    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:51.721517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.721042    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:51.721517 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.721108    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:51.803838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.803776    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 31 13:14:51.924682 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.919694    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:51.945798 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:51.945749    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:52.040779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.040736    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:52.042478 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.042449    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:52.042723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.042695    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:52.214846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.214805    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:52.216041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.215996    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:52.216394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.216373    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:52.219257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.219223    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:52.219438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.219415    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:52.237643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.235704    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:52.275860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.273673    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:52.278935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.278866    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:52.279144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.278932    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:52.326956 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.326920    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:52.367648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.327739    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:52.367648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.343980    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:52.519687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.518326    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:52.519687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.518398    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:52.575324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.575277    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:14:52.736516 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.736471    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:52.736766 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.736550    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:52.816927 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.816819    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:52.876806 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:52.876767    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:14:53.054529 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.054473    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:53.082927 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.082816    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:53.278738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.266319    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": context deadline exceeded"
Oct 31 13:14:53.278738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.268776    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:53.278738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.268828    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:53.278738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.270484    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:53.278738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.270682    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:53.282632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.282582    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:53.304786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.304738    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:53.318711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.318665    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:53.319031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.318985    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:53.578486 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.578439    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:53.724928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.724889    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:53.726699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.726660    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:53.817957 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.817900    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": context deadline exceeded"
Oct 31 13:14:53.858968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.858842    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:53.949658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.919798    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:53.949658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:53.946183    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:14:54.234700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.203625    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 31 13:14:54.234700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.203688    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 31 13:14:54.234700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.221116    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:54.234700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.221182    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:54.270573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.270526    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:54.275449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.272214    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:54.284987 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.280318    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:54.286861 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.286824    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:54.287056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.280482    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:54.317123 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.317089    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:54.317426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.317393    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:54.599820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.579824    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:54.753433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.753398    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:54.754657 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:54.754601    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:55.204971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.204939    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:14:55.213712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.213677    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 31 13:14:55.213968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.213943    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 31 13:14:55.339827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.339782    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:55.340328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.340301    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:55.378892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.378850    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 31 13:14:55.379088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.378915    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 31 13:14:55.379088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.378995    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:55.379088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.379019    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:55.473694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.462064    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:55.612629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.607875    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:55.721905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.721864    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:55.722108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.721923    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:55.740028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.739946    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:14:55.800231 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:55.800196    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:14:56.075199 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.075091    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:56.075462 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.075428    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:56.320071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.320029    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:56.422164 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.422074    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 31 13:14:56.422403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.422376    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 31 13:14:56.438900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.438863    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:14:56.820886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.820845    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 13:14:56.821550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:56.821509    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 13:14:57.453164 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.452713    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:57.453164 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.452792    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:57.477258 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.475723    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:57.477258 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.475804    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:57.477258 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.476318    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:57.530631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.502897    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:57.548004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.547960    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:14:57.826823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:57.826780    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:58.080242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.079418    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:58.099469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.099436    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:58.115928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.115893    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:14:58.347854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.347736    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:14:58.489630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.485802    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:58.489630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.486343    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:58.529629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.519985    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:58.553630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.529911    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:58.798747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.798708    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:58.799030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:58.798992    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:59.090626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.090501    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 31 13:14:59.220095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.219482    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:14:59.238182 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.238144    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:14:59.303409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.303356    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:14:59.569661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.556524    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:59.640713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.640667    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:14:59.985631 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:14:59.970795    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:14:59.992625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.992573    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:14:59.993357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.993324    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:14:59.997444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:14:59.997419    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:15:00.313949 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.313842    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:00.329629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.324454    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.349629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.330090    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:15:00.349629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.330847    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:00.349629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.339651    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:00.367835 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.363909    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.398237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.398155    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:00.441572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.440647    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.441572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.440972    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46q6v\" (UniqueName: \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.441572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.441239    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6ptp\" (UniqueName: \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.441572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.441296    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.545046 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.545004    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46q6v\" (UniqueName: \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.545494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.545469    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6ptp\" (UniqueName: \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.545669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.545653    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.545884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.545868    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.547087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.547061    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.548582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.548403    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.582415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.582326    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6ptp\" (UniqueName: \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\") pod \"maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:00.597337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.597287    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46q6v\" (UniqueName: \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\") pod \"maas-api-key-cleanup-29890875-jpdjf\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.652717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.652682    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:15:00.655323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.655253    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:15:00.683994 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.683956    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:00.719146 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.719107    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:00.755524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:00.755492    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:01.118921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:01.118833    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:01.119176 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:15:01.118911    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7453b3e_adf7_4644_9e92_2c9a77da4dce.slice/crio-12a23f71aea884e0a301422cd7bf6910e5854fc1e5bc163f2c18d57ef92069f2 WatchSource:0}: Error finding container 12a23f71aea884e0a301422cd7bf6910e5854fc1e5bc163f2c18d57ef92069f2: Status 404 returned error can't find the container with id 12a23f71aea884e0a301422cd7bf6910e5854fc1e5bc163f2c18d57ef92069f2
Oct 31 13:15:01.138583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:01.138556    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:01.141173 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:15:01.141140    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode071dbaf_525c_43ba_9acc_e56627dc1f5f.slice/crio-013f754b734a670ddf0622ee77dfa5e9ef82cdc42da858e23911b9eb19f7a6c1 WatchSource:0}: Error finding container 013f754b734a670ddf0622ee77dfa5e9ef82cdc42da858e23911b9eb19f7a6c1: Status 404 returned error can't find the container with id 013f754b734a670ddf0622ee77dfa5e9ef82cdc42da858e23911b9eb19f7a6c1
Oct 31 13:15:01.277329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:01.277292    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:01.770703 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:01.770671    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:02.117523 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.117409    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerStarted","Data":"322746a927a102f5e041efa5af0de2e2425de8b5693310571031e4986aa955aa"}
Oct 31 13:15:02.117753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.117530    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerStarted","Data":"12a23f71aea884e0a301422cd7bf6910e5854fc1e5bc163f2c18d57ef92069f2"}
Oct 31 13:15:02.123383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.123347    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerStarted","Data":"6f364b2f8f1da14dff9ecfdf7c921464340ac39069d3cfd0411503ac5c7746da"}
Oct 31 13:15:02.123737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.123713    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerStarted","Data":"013f754b734a670ddf0622ee77dfa5e9ef82cdc42da858e23911b9eb19f7a6c1"}
Oct 31 13:15:02.143845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.143789    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" podStartSLOduration=2.1437714 podStartE2EDuration="2.1437714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:15:02.138986449 +0000 UTC m=+923.802412134" watchObservedRunningTime="2026-10-31 13:15:02.1437714 +0000 UTC m=+923.807197148"
Oct 31 13:15:02.160822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:02.160762    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" podStartSLOduration=2.160742629 podStartE2EDuration="2.160742629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:15:02.160295622 +0000 UTC m=+923.823721306" watchObservedRunningTime="2026-10-31 13:15:02.160742629 +0000 UTC m=+923.824168314"
Oct 31 13:15:03.008197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.008153    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:03.135585 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.135548    4958 generic.go:356] "Generic (PLEG): container finished" podID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerID="322746a927a102f5e041efa5af0de2e2425de8b5693310571031e4986aa955aa" exitCode=60
Oct 31 13:15:03.135794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.135665    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerDied","Data":"322746a927a102f5e041efa5af0de2e2425de8b5693310571031e4986aa955aa"}
Oct 31 13:15:03.136090 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.136071    4958 scope.go:122] "RemoveContainer" containerID="322746a927a102f5e041efa5af0de2e2425de8b5693310571031e4986aa955aa"
Oct 31 13:15:03.137734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.137706    4958 generic.go:356] "Generic (PLEG): container finished" podID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerID="6f364b2f8f1da14dff9ecfdf7c921464340ac39069d3cfd0411503ac5c7746da" exitCode=60
Oct 31 13:15:03.137863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.137794    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerDied","Data":"6f364b2f8f1da14dff9ecfdf7c921464340ac39069d3cfd0411503ac5c7746da"}
Oct 31 13:15:03.138096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.138059    4958 scope.go:122] "RemoveContainer" containerID="6f364b2f8f1da14dff9ecfdf7c921464340ac39069d3cfd0411503ac5c7746da"
Oct 31 13:15:03.878372 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:03.878243    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:04.161327 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.161264    4958 generic.go:356] "Generic (PLEG): container finished" podID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerID="8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0" exitCode=60
Oct 31 13:15:04.162187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.162158    4958 scope.go:122] "RemoveContainer" containerID="8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0"
Oct 31 13:15:04.162343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.161595    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerDied","Data":"8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0"}
Oct 31 13:15:04.162905 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:04.162875    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890875-jpdjf_odh-ai-gateway-infra(d7453b3e-adf7-4644-9e92-2c9a77da4dce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce"
Oct 31 13:15:04.167374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.167165    4958 scope.go:122] "RemoveContainer" containerID="322746a927a102f5e041efa5af0de2e2425de8b5693310571031e4986aa955aa"
Oct 31 13:15:04.169228 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.169031    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerStarted","Data":"91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"}
Oct 31 13:15:04.708533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:04.708493    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:05.180697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.180582    4958 scope.go:122] "RemoveContainer" containerID="8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0"
Oct 31 13:15:05.181228 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:05.181006    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890875-jpdjf_odh-ai-gateway-infra(d7453b3e-adf7-4644-9e92-2c9a77da4dce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce"
Oct 31 13:15:05.182505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.182479    4958 generic.go:356] "Generic (PLEG): container finished" podID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerID="91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560" exitCode=60
Oct 31 13:15:05.182630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.182584    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerDied","Data":"91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"}
Oct 31 13:15:05.182671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.182657    4958 scope.go:122] "RemoveContainer" containerID="6f364b2f8f1da14dff9ecfdf7c921464340ac39069d3cfd0411503ac5c7746da"
Oct 31 13:15:05.182902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.182876    4958 scope.go:122] "RemoveContainer" containerID="91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"
Oct 31 13:15:05.183286 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:05.183262    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5_odh-ai-gateway-infra(e071dbaf-525c-43ba-9acc-e56627dc1f5f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f"
Oct 31 13:15:05.587845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.587812    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:05.936789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:05.936698    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:06.200125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:06.200036    4958 scope.go:122] "RemoveContainer" containerID="91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"
Oct 31 13:15:06.200595 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:06.200384    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5_odh-ai-gateway-infra(e071dbaf-525c-43ba-9acc-e56627dc1f5f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f"
Oct 31 13:15:06.215665 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:06.215631    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:15:06.358318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:06.358278    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:06.887647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:06.886729    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:08.304626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:08.303550    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:09.268378 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:09.268337    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:10.008354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:10.008308    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:10.800986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:10.800949    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:10.924216 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:10.924178    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:15:11.066153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:11.066051    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:11.733255 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:11.733175    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:11.849726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:11.849691    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:15:11.876719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:11.874403    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:15:11.974939 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:11.974902    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:12.113461 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.113375    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:12.591699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.591659    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"]
Oct 31 13:15:12.598983 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.598953    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.607400 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.607372    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:15:12.612204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.612160    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"]
Oct 31 13:15:12.632713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.632494    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.632713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.632618    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.633837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.633799    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zplsw\" (UniqueName: \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.735065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.735027    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.735306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.735182    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.735306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.735296    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zplsw\" (UniqueName: \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.736169 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.736142    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.738402 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.738378    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.752195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.752161    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zplsw\" (UniqueName: \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\") pod \"maas-api-revoke-sub-0a049f62-v6gpv\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:12.942411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:12.942311    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:13.086716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:13.083177    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:13.521092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:13.520149    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"]
Oct 31 13:15:14.118417 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.118258    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:14.395572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.395470    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv" event={"ID":"f9833e49-dc30-40cd-af38-830f607dc68d","Type":"ContainerStarted","Data":"0b366bcabbdcac0479dcd9dd9b29569904d969168f38470a256a7316d9b46c22"}
Oct 31 13:15:14.395572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.395541    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv" event={"ID":"f9833e49-dc30-40cd-af38-830f607dc68d","Type":"ContainerStarted","Data":"3c079be0ed6e1d709309be7fa73f1ff43f362de63825d660fe3f922108ed39c6"}
Oct 31 13:15:14.422097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.422032    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv" podStartSLOduration=2.422013919 podStartE2EDuration="2.422013919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:15:14.416230622 +0000 UTC m=+936.079656324" watchObservedRunningTime="2026-10-31 13:15:14.422013919 +0000 UTC m=+936.085439604"
Oct 31 13:15:14.484553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.484522    4958 scope.go:122] "RemoveContainer" containerID="91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"
Oct 31 13:15:14.938938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:14.938891    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:15.405006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:15.404967    4958 generic.go:356] "Generic (PLEG): container finished" podID="f9833e49-dc30-40cd-af38-830f607dc68d" containerID="0b366bcabbdcac0479dcd9dd9b29569904d969168f38470a256a7316d9b46c22" exitCode=0
Oct 31 13:15:15.405210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:15.405053    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv" event={"ID":"f9833e49-dc30-40cd-af38-830f607dc68d","Type":"ContainerDied","Data":"0b366bcabbdcac0479dcd9dd9b29569904d969168f38470a256a7316d9b46c22"}
Oct 31 13:15:15.407184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:15.407159    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerStarted","Data":"00df10d956a51c1da1c4627cec2c4c7e14fdbb347e027df85028929c169fd682"}
Oct 31 13:15:15.792588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:15.792544    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:16.219812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.219770    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:15:16.237848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.237800    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:15:16.316973 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.316932    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:16.417298 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.417268    4958 generic.go:356] "Generic (PLEG): container finished" podID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerID="00df10d956a51c1da1c4627cec2c4c7e14fdbb347e027df85028929c169fd682" exitCode=60
Oct 31 13:15:16.417463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.417341    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerDied","Data":"00df10d956a51c1da1c4627cec2c4c7e14fdbb347e027df85028929c169fd682"}
Oct 31 13:15:16.417463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.417402    4958 scope.go:122] "RemoveContainer" containerID="91011ac049239a1be8365d3005adf5a8505944e28a12ef1cffcee4dead374560"
Oct 31 13:15:16.418236 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.418030    4958 scope.go:122] "RemoveContainer" containerID="00df10d956a51c1da1c4627cec2c4c7e14fdbb347e027df85028929c169fd682"
Oct 31 13:15:16.418479 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:16.418449    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5_odh-ai-gateway-infra(e071dbaf-525c-43ba-9acc-e56627dc1f5f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f"
Oct 31 13:15:16.467487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.467448    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:16.475284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.475203    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:16.802174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.796281    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:16.851797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.851641    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing" containerID="cri-o://654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58" gracePeriod=25
Oct 31 13:15:16.875126 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.874741    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing" containerID="cri-o://2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3" gracePeriod=25
Oct 31 13:15:16.883452 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.883421    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:16.944952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.944912    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\" (UniqueName: \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\") pod \"f9833e49-dc30-40cd-af38-830f607dc68d\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") "
Oct 31 13:15:16.945167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.944961    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\") pod \"f9833e49-dc30-40cd-af38-830f607dc68d\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") "
Oct 31 13:15:16.945167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.945134    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\") pod \"f9833e49-dc30-40cd-af38-830f607dc68d\" (UID: \"f9833e49-dc30-40cd-af38-830f607dc68d\") "
Oct 31 13:15:16.946754 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.946723    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca" pod "f9833e49-dc30-40cd-af38-830f607dc68d" (UID: "f9833e49-dc30-40cd-af38-830f607dc68d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:16.949597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.949569    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca" pod "f9833e49-dc30-40cd-af38-830f607dc68d" (UID: "f9833e49-dc30-40cd-af38-830f607dc68d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:16.949728 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:16.949708    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw" pod "f9833e49-dc30-40cd-af38-830f607dc68d" (UID: "f9833e49-dc30-40cd-af38-830f607dc68d"). InnerVolumeSpecName "kube-api-access-zplsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:17.047415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.047363    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zplsw\" (UniqueName: \"kubernetes.io/projected/f9833e49-dc30-40cd-af38-830f607dc68d-kube-api-access-zplsw\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:17.047415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.047411    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:17.047708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.047428    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f9833e49-dc30-40cd-af38-830f607dc68d-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:17.450972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.450935    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv" event={"ID":"f9833e49-dc30-40cd-af38-830f607dc68d","Type":"ContainerDied","Data":"3c079be0ed6e1d709309be7fa73f1ff43f362de63825d660fe3f922108ed39c6"}
Oct 31 13:15:17.451388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.451032    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c079be0ed6e1d709309be7fa73f1ff43f362de63825d660fe3f922108ed39c6"
Oct 31 13:15:17.451388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.451123    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"
Oct 31 13:15:17.628515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.628477    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:17.667191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.667153    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\" (UniqueName: \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\") pod \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") "
Oct 31 13:15:17.667435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.667415    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\") pod \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\" (UID: \"e071dbaf-525c-43ba-9acc-e56627dc1f5f\") "
Oct 31 13:15:17.667853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.667825    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca" pod "e071dbaf-525c-43ba-9acc-e56627dc1f5f" (UID: "e071dbaf-525c-43ba-9acc-e56627dc1f5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:17.668505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.668276    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e071dbaf-525c-43ba-9acc-e56627dc1f5f-maas-api-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:17.669706 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.669680    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp" pod "e071dbaf-525c-43ba-9acc-e56627dc1f5f" (UID: "e071dbaf-525c-43ba-9acc-e56627dc1f5f"). InnerVolumeSpecName "kube-api-access-s6ptp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:17.703374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.703225    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:17.770569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:17.770328    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6ptp\" (UniqueName: \"kubernetes.io/projected/e071dbaf-525c-43ba-9acc-e56627dc1f5f-kube-api-access-s6ptp\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:18.462751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.462717    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"
Oct 31 13:15:18.462751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.462736    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5" event={"ID":"e071dbaf-525c-43ba-9acc-e56627dc1f5f","Type":"ContainerDied","Data":"013f754b734a670ddf0622ee77dfa5e9ef82cdc42da858e23911b9eb19f7a6c1"}
Oct 31 13:15:18.463323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.462795    4958 scope.go:122] "RemoveContainer" containerID="00df10d956a51c1da1c4627cec2c4c7e14fdbb347e027df85028929c169fd682"
Oct 31 13:15:18.494724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.494695    4958 scope.go:122] "RemoveContainer" containerID="8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0"
Oct 31 13:15:18.544625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.543054    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:18.562632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.556458    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:18.574282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.571897    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-2a262a-29890875-sdgb5"]
Oct 31 13:15:18.678623 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:18.678574    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:19.471711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:19.471253    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:19.472483 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:19.472451    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:19.476597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:19.476568    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerStarted","Data":"8c28ce67b045be3e2572cc3e0f20030c2c9d20d65434135061383a092612e079"}
Oct 31 13:15:19.625569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:19.620566    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:20.165392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.165362    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:20.499882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.499843    4958 generic.go:356] "Generic (PLEG): container finished" podID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerID="8c28ce67b045be3e2572cc3e0f20030c2c9d20d65434135061383a092612e079" exitCode=60
Oct 31 13:15:20.503630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.503581    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" path="/var/lib/kubelet/pods/e071dbaf-525c-43ba-9acc-e56627dc1f5f/volumes"
Oct 31 13:15:20.504350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.504318    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerDied","Data":"8c28ce67b045be3e2572cc3e0f20030c2c9d20d65434135061383a092612e079"}
Oct 31 13:15:20.504590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.504563    4958 scope.go:122] "RemoveContainer" containerID="8bbab54534bc499c98a11f66069b985aeecffe40b22bb6cb00e65a4e962778c0"
Oct 31 13:15:20.505159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.505131    4958 scope.go:122] "RemoveContainer" containerID="8c28ce67b045be3e2572cc3e0f20030c2c9d20d65434135061383a092612e079"
Oct 31 13:15:20.505578 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:20.505555    4958 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29890875-jpdjf_odh-ai-gateway-infra(d7453b3e-adf7-4644-9e92-2c9a77da4dce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce"
Oct 31 13:15:20.548717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:20.548673    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:21.226632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.220721    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing" containerID="cri-o://efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c" gracePeriod=25
Oct 31 13:15:21.253750 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.253696    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing" containerID="cri-o://c589084f6150c563f6fb8220bd7256ce3a3b7347c0d4abad02c1a1b08646c15d" gracePeriod=25
Oct 31 13:15:21.317662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.316291    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" containerID="cri-o://3a5e474572873cfa4909676924148fa1f486f8bbdf16e53c7afc20789c4c71b2" gracePeriod=45
Oct 31 13:15:21.371043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.355854    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": read tcp 10.132.0.2:58702->10.132.0.93:8000: read: connection reset by peer"
Oct 31 13:15:21.498784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.481892    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:21.694071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.693950    4958 generic.go:356] "Generic (PLEG): container finished" podID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerID="3a5e474572873cfa4909676924148fa1f486f8bbdf16e53c7afc20789c4c71b2" exitCode=0
Oct 31 13:15:21.694563 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:21.694210    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" event={"ID":"ab70d256-8f3f-4cc5-acde-8085b20c0e1a","Type":"ContainerDied","Data":"3a5e474572873cfa4909676924148fa1f486f8bbdf16e53c7afc20789c4c71b2"}
Oct 31 13:15:22.040734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:22.037182    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": dial tcp 10.132.0.93:8000: connect: connection refused"
Oct 31 13:15:22.040734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:22.037342    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:15:22.751632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:22.742001    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:22.766197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:22.760825    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:23.223694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.219251    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227117    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227208    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227242    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227319    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227423    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.227537    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\" (UniqueName: \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\") pod \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\" (UID: \"ab70d256-8f3f-4cc5-acde-8085b20c0e1a\") "
Oct 31 13:15:23.244628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.241721    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:23.279713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.262893    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:23.279713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.271943    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:23.279713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.273312    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:23.293668 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.292141    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:23.295358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.295279    4958 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-home\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:23.295358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.295313    4958 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tmp-dir\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:23.295358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.295328    4958 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-model-cache\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:23.749354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.749308    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:23.779783 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.779741    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:23.807847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.807759    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:23.828217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.828171    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:23.842899 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.842860    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv" pod "ab70d256-8f3f-4cc5-acde-8085b20c0e1a" (UID: "ab70d256-8f3f-4cc5-acde-8085b20c0e1a"). InnerVolumeSpecName "kube-api-access-x9wcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:23.847969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.847865    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:23.908593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.908270    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\") pod \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") "
Oct 31 13:15:23.932700 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.932653    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\" (UniqueName: \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\") pod \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\" (UID: \"d7453b3e-adf7-4644-9e92-2c9a77da4dce\") "
Oct 31 13:15:23.933982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.933944    4958 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-tls-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:24.064941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.934159    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9wcv\" (UniqueName: \"kubernetes.io/projected/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-kube-api-access-x9wcv\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:24.099633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.065922    4958 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab70d256-8f3f-4cc5-acde-8085b20c0e1a-dshm\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.945305    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca" pod "d7453b3e-adf7-4644-9e92-2c9a77da4dce" (UID: "d7453b3e-adf7-4644-9e92-2c9a77da4dce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.972528    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v" pod "d7453b3e-adf7-4644-9e92-2c9a77da4dce" (UID: "d7453b3e-adf7-4644-9e92-2c9a77da4dce"). InnerVolumeSpecName "kube-api-access-46q6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.956734    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.956637    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" event={"ID":"ab70d256-8f3f-4cc5-acde-8085b20c0e1a","Type":"ContainerDied","Data":"49b7796ac8463b61d4da90715f5ce7b6769e4ff8b2daf71c54b8df623ec7e8d8"}
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.121818    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf" event={"ID":"d7453b3e-adf7-4644-9e92-2c9a77da4dce","Type":"ContainerDied","Data":"12a23f71aea884e0a301422cd7bf6910e5854fc1e5bc163f2c18d57ef92069f2"}
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.921998    4958 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:24.124660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:23.958989    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"
Oct 31 13:15:24.190692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.053808    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:24.190692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.154662    4958 scope.go:122] "RemoveContainer" containerID="3a5e474572873cfa4909676924148fa1f486f8bbdf16e53c7afc20789c4c71b2"
Oct 31 13:15:24.277865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.271964    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7453b3e-adf7-4644-9e92-2c9a77da4dce-maas-api-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:24.277865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.272003    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46q6v\" (UniqueName: \"kubernetes.io/projected/d7453b3e-adf7-4644-9e92-2c9a77da4dce-kube-api-access-46q6v\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:24.277865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.272109    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:24.278644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.278152    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:15:24.286814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.284967    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:24.286814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.285146    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:15:24.787629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.784105    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:24.829530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:24.829482    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:25.025178 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.025146    4958 scope.go:122] "RemoveContainer" containerID="8c28ce67b045be3e2572cc3e0f20030c2c9d20d65434135061383a092612e079"
Oct 31 13:15:25.192715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.123919    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:25.223745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.223709    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:15:25.231633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.227734    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:15:25.404636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.285216    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:25.582686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.368380    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:25.586749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.416365    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:15:25.656952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.656914    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-f9e24f/distinct-2-w5-f9e24f-kserve-8567468dff-ljr9k"]
Oct 31 13:15:25.711729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.697758    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:15:25.785629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.785479    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:25.850688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.847250    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:25.996657 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:25.981786    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" containerID="cri-o://0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046" gracePeriod=45
Oct 31 13:15:26.595107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:26.595036    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 13:15:26.793661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:26.793586    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:26.829982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:26.829932    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:26.940851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:26.908777    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.92:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:27.192688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.190952    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": read tcp 10.132.0.2:54236->10.132.0.81:8000: read: connection reset by peer"
Oct 31 13:15:27.500953 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.500482    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" path="/var/lib/kubelet/pods/ab70d256-8f3f-4cc5-acde-8085b20c0e1a/volumes"
Oct 31 13:15:27.507780 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:27.501281    4958 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.01s"
Oct 31 13:15:27.507780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.501372    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:27.507780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.501432    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:27.507780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.501453    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890875-jpdjf"]
Oct 31 13:15:27.552463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.546657    4958 generic.go:356] "Generic (PLEG): container finished" podID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerID="0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046" exitCode=0
Oct 31 13:15:27.595048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.595008    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:15:27.599984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.599958    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:27.600284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.600252    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" event={"ID":"bf52c40f-75af-4a67-8f9f-79fb782ff439","Type":"ContainerDied","Data":"0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046"}
Oct 31 13:15:27.606346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.606077    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:15:27.706854 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:27.706814    4958 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf52c40f_75af_4a67_8f9f_79fb782ff439.slice/crio-0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf52c40f_75af_4a67_8f9f_79fb782ff439.slice/crio-conmon-0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 13:15:27.773600 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.773519    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:27.849404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.849364    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:15:27.909569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.909521    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.909872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.909846    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.909964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.909894    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\" (UniqueName: \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.910163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910055    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.910163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910121    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:27.910322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910243    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.910322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910292    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\") pod \"bf52c40f-75af-4a67-8f9f-79fb782ff439\" (UID: \"bf52c40f-75af-4a67-8f9f-79fb782ff439\") "
Oct 31 13:15:27.910593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910565    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:27.910737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.910698    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:27.911237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.911203    4958 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-home\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:27.911237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.911235    4958 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-model-cache\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:27.911428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.911250    4958 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-tmp-dir\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:27.912334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.912312    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:27.912937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.912909    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:27.913613 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:27.913580    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9" pod "bf52c40f-75af-4a67-8f9f-79fb782ff439" (UID: "bf52c40f-75af-4a67-8f9f-79fb782ff439"). InnerVolumeSpecName "kube-api-access-p5tt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:28.012484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.012450    4958 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf52c40f-75af-4a67-8f9f-79fb782ff439-dshm\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:28.012484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.012481    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5tt9\" (UniqueName: \"kubernetes.io/projected/bf52c40f-75af-4a67-8f9f-79fb782ff439-kube-api-access-p5tt9\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:28.012950 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.012495    4958 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf52c40f-75af-4a67-8f9f-79fb782ff439-tls-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:28.495356 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.495320    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" path="/var/lib/kubelet/pods/d7453b3e-adf7-4644-9e92-2c9a77da4dce/volumes"
Oct 31 13:15:28.553286 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.553230    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:28.566470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.566392    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" event={"ID":"bf52c40f-75af-4a67-8f9f-79fb782ff439","Type":"ContainerDied","Data":"f379e1fd97d0b3fb622ff792120ee42ac65a2f2306d083999e666bff778bd242"}
Oct 31 13:15:28.566470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.566445    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"
Oct 31 13:15:28.567381 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.566452    4958 scope.go:122] "RemoveContainer" containerID="0858ab329f2b2fda2161baf4b48a939d04247a92f1c80478e6102f2ab21f3046"
Oct 31 13:15:28.597172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.597132    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:15:28.606186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.606147    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc"]
Oct 31 13:15:28.741365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:28.741313    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a2c006/premium-w1-a2c006-kserve-79cf645d99-d5klc" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:29.336724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:29.336683    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:29.471802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:29.471746    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:29.472012 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:29.471904    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:29.579808 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:29.579769    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:15:29.715372 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:29.715184    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:30.374593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.374551    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:15:30.375110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.374824    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" podUID="bd3683c7-fd58-47ea-a551-e3a341947f7a" containerName="maas-api" containerID="cri-o://d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9" gracePeriod=30
Oct 31 13:15:30.437288 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.436944    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:30.496153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.496110    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" path="/var/lib/kubelet/pods/bf52c40f-75af-4a67-8f9f-79fb782ff439/volumes"
Oct 31 13:15:30.643357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.636745    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:30.785337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.785301    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:30.938033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:30.935251    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:31.229102 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.229075    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:15:31.291075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.291027    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\" (UniqueName: \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\") pod \"bd3683c7-fd58-47ea-a551-e3a341947f7a\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") "
Oct 31 13:15:31.291273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.291241    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\") pod \"bd3683c7-fd58-47ea-a551-e3a341947f7a\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") "
Oct 31 13:15:31.291337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.291279    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\") pod \"bd3683c7-fd58-47ea-a551-e3a341947f7a\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") "
Oct 31 13:15:31.291398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.291368    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\") pod \"bd3683c7-fd58-47ea-a551-e3a341947f7a\" (UID: \"bd3683c7-fd58-47ea-a551-e3a341947f7a\") "
Oct 31 13:15:31.292055 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.292020    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca" pod "bd3683c7-fd58-47ea-a551-e3a341947f7a" (UID: "bd3683c7-fd58-47ea-a551-e3a341947f7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:31.292295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.292274    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3683c7-fd58-47ea-a551-e3a341947f7a-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:31.294304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.294278    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls" pod "bd3683c7-fd58-47ea-a551-e3a341947f7a" (UID: "bd3683c7-fd58-47ea-a551-e3a341947f7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:31.303752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.294968    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp" pod "bd3683c7-fd58-47ea-a551-e3a341947f7a" (UID: "bd3683c7-fd58-47ea-a551-e3a341947f7a"). InnerVolumeSpecName "kube-api-access-jfwwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:31.303752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.295220    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs" pod "bd3683c7-fd58-47ea-a551-e3a341947f7a" (UID: "bd3683c7-fd58-47ea-a551-e3a341947f7a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:31.336593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.336546    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:31.394291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.394258    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfwwp\" (UniqueName: \"kubernetes.io/projected/bd3683c7-fd58-47ea-a551-e3a341947f7a-kube-api-access-jfwwp\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:31.394291 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.394288    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:31.394749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.394305    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3683c7-fd58-47ea-a551-e3a341947f7a-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:31.608701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.608661    4958 generic.go:356] "Generic (PLEG): container finished" podID="bd3683c7-fd58-47ea-a551-e3a341947f7a" containerID="d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9" exitCode=0
Oct 31 13:15:31.608921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.608721    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"
Oct 31 13:15:31.608921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.608755    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" event={"ID":"bd3683c7-fd58-47ea-a551-e3a341947f7a","Type":"ContainerDied","Data":"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"}
Oct 31 13:15:31.608921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.608832    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5" event={"ID":"bd3683c7-fd58-47ea-a551-e3a341947f7a","Type":"ContainerDied","Data":"70c2ba46053cfe1bb3aef68cf039f3c909ffbfcab2ea37834561fe2546556489"}
Oct 31 13:15:31.608921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.608863    4958 scope.go:122] "RemoveContainer" containerID="d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"
Oct 31 13:15:31.622404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.622380    4958 scope.go:122] "RemoveContainer" containerID="d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"
Oct 31 13:15:31.622782 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:31.622752    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9\": container with ID starting with d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9 not found: ID does not exist" containerID="d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"
Oct 31 13:15:31.622860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.622796    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9"} err="failed to get container status \"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9\": rpc error: code = NotFound desc = could not find container \"d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9\": container with ID starting with d11827a1213322e6cd989ba239f4c51b587dd90937670d3e547b6d44284c81b9 not found: ID does not exist"
Oct 31 13:15:31.662204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.662161    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:15:31.669374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.669335    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-f9e24f-cbdfddb96-8fnn5"]
Oct 31 13:15:31.892936 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:31.892859    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:32.493797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.493759    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd3683c7-fd58-47ea-a551-e3a341947f7a" path="/var/lib/kubelet/pods/bd3683c7-fd58-47ea-a551-e3a341947f7a/volumes"
Oct 31 13:15:32.561218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.559225    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:32.561218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.559409    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:32.673942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.673905    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:15:32.817974 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.817882    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:32.960847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:32.960807    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:33.796153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:33.796116    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:34.724627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:34.723638    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:35.581348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:35.581305    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:36.469590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:36.469550    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:37.101575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.101536    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:15:37.186446 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.186410    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:15:37.217305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.217270    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\" (UniqueName: \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\") pod \"86f66737-e1d1-47d9-98b9-72e115fc780e\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") "
Oct 31 13:15:37.217962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.217934    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\") pod \"86f66737-e1d1-47d9-98b9-72e115fc780e\" (UID: \"86f66737-e1d1-47d9-98b9-72e115fc780e\") "
Oct 31 13:15:37.218647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.218475    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume" pod "86f66737-e1d1-47d9-98b9-72e115fc780e" (UID: "86f66737-e1d1-47d9-98b9-72e115fc780e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:37.219332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.219306    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86f66737-e1d1-47d9-98b9-72e115fc780e-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:37.227535 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.227480    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd" pod "86f66737-e1d1-47d9-98b9-72e115fc780e" (UID: "86f66737-e1d1-47d9-98b9-72e115fc780e"). InnerVolumeSpecName "kube-api-access-zs4xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:37.320659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.320597    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\" (UniqueName: \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\") pod \"5ac16359-9bac-4b04-926b-517e4bb611c6\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") "
Oct 31 13:15:37.320933 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.320915    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\") pod \"5ac16359-9bac-4b04-926b-517e4bb611c6\" (UID: \"5ac16359-9bac-4b04-926b-517e4bb611c6\") "
Oct 31 13:15:37.321364 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.321334    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume" pod "5ac16359-9bac-4b04-926b-517e4bb611c6" (UID: "5ac16359-9bac-4b04-926b-517e4bb611c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:37.321549 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.321527    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs4xd\" (UniqueName: \"kubernetes.io/projected/86f66737-e1d1-47d9-98b9-72e115fc780e-kube-api-access-zs4xd\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:37.321636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.321554    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ac16359-9bac-4b04-926b-517e4bb611c6-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:37.323186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.323156    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7" pod "5ac16359-9bac-4b04-926b-517e4bb611c6" (UID: "5ac16359-9bac-4b04-926b-517e4bb611c6"). InnerVolumeSpecName "kube-api-access-wrgn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:37.394935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.394893    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:37.431693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.427040    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrgn7\" (UniqueName: \"kubernetes.io/projected/5ac16359-9bac-4b04-926b-517e4bb611c6-kube-api-access-wrgn7\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:37.670708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.670661    4958 generic.go:356] "Generic (PLEG): container finished" podID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerID="654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58" exitCode=0
Oct 31 13:15:37.670945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.670757    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" event={"ID":"86f66737-e1d1-47d9-98b9-72e115fc780e","Type":"ContainerDied","Data":"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"}
Oct 31 13:15:37.670945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.670774    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"
Oct 31 13:15:37.670945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.670814    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj" event={"ID":"86f66737-e1d1-47d9-98b9-72e115fc780e","Type":"ContainerDied","Data":"6ea3a0d3996b1ba14ed2ddcade3c2e3a4a26e1d0f49659bba12cf20baf3d6886"}
Oct 31 13:15:37.670945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.670844    4958 scope.go:122] "RemoveContainer" containerID="654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"
Oct 31 13:15:37.673512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.673486    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"
Oct 31 13:15:37.673652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.673503    4958 generic.go:356] "Generic (PLEG): container finished" podID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerID="2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3" exitCode=0
Oct 31 13:15:37.673721 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.673696    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" event={"ID":"5ac16359-9bac-4b04-926b-517e4bb611c6","Type":"ContainerDied","Data":"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"}
Oct 31 13:15:37.673792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.673749    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w" event={"ID":"5ac16359-9bac-4b04-926b-517e4bb611c6","Type":"ContainerDied","Data":"4d73308d474b9115af7dee7ba515823e0c0df9d231616df136ac51fd87d023eb"}
Oct 31 13:15:37.688884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.686389    4958 scope.go:122] "RemoveContainer" containerID="654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"
Oct 31 13:15:37.688884 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:37.686770    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58\": container with ID starting with 654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58 not found: ID does not exist" containerID="654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"
Oct 31 13:15:37.688884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.686806    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58"} err="failed to get container status \"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58\": rpc error: code = NotFound desc = could not find container \"654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58\": container with ID starting with 654519d3e8566f9c80a2fb0aa1a04ec4e923b40abb0143227e48c80e69dfae58 not found: ID does not exist"
Oct 31 13:15:37.688884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.686823    4958 scope.go:122] "RemoveContainer" containerID="2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"
Oct 31 13:15:37.703817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.703791    4958 scope.go:122] "RemoveContainer" containerID="2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"
Oct 31 13:15:37.704275 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:37.704197    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3\": container with ID starting with 2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3 not found: ID does not exist" containerID="2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"
Oct 31 13:15:37.704275 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.704242    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3"} err="failed to get container status \"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3\": rpc error: code = NotFound desc = could not find container \"2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3\": container with ID starting with 2690ebabcb2ab026512c1fdc6d47e9c8783a97a5fc27d8114e4a451f6291aaf3 not found: ID does not exist"
Oct 31 13:15:37.710764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.710692    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:15:37.717096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.717060    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-f9e24f-64f9f6d4fc-n6swj"]
Oct 31 13:15:37.728062 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.728024    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:15:37.735512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:37.735480    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-f9e24f-79488b6dff-fqc9w"]
Oct 31 13:15:38.165343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.165297    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:15:38.317807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.317751    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:38.494863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.494824    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" path="/var/lib/kubelet/pods/5ac16359-9bac-4b04-926b-517e4bb611c6/volumes"
Oct 31 13:15:38.495318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.495301    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" path="/var/lib/kubelet/pods/86f66737-e1d1-47d9-98b9-72e115fc780e/volumes"
Oct 31 13:15:38.514397 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.514349    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:38.676627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:38.672155    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:39.254556 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.254520    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:39.411498 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.411441    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:39.587869 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.577407    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:15:39.588141 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.588120    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:15:39.608912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.608883    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:15:39.609504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.609172    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" containerID="cri-o://19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd" gracePeriod=30
Oct 31 13:15:39.609504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.609287    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" containerID="cri-o://448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8" gracePeriod=30
Oct 31 13:15:39.610032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.588431    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" containerID="cri-o://d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52" gracePeriod=30
Oct 31 13:15:39.691683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.691647    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:39.890688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:39.890369    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:40.403273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:40.403231    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:40.603544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:40.603509    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:40.756752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:40.756707    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:40.965316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:40.965276    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:15:40.984476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:40.984441    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:15:41.113342 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.113254    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:41.271854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.271819    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:41.375799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.374085    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:15:41.375799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.374152    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:15:41.659108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.659080    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:15:41.687571 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.687537    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\" (UniqueName: \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\") pod \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") "
Oct 31 13:15:41.690914 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.690878    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5" pod "e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" (UID: "e4e3ef82-cab7-4a86-9377-d7f18fcb3b04"). InnerVolumeSpecName "kube-api-access-z6ww5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:41.789582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.789543    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\") pod \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\" (UID: \"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04\") "
Oct 31 13:15:41.790019 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.789989    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume" pod "e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" (UID: "e4e3ef82-cab7-4a86-9377-d7f18fcb3b04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:41.790176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.790158    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:41.790233 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.790182    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6ww5\" (UniqueName: \"kubernetes.io/projected/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04-kube-api-access-z6ww5\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:41.904991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.904895    4958 generic.go:356] "Generic (PLEG): container finished" podID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerID="efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c" exitCode=0
Oct 31 13:15:41.904991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.904942    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"
Oct 31 13:15:41.904991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.904981    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" event={"ID":"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04","Type":"ContainerDied","Data":"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"}
Oct 31 13:15:41.905278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.905039    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j" event={"ID":"e4e3ef82-cab7-4a86-9377-d7f18fcb3b04","Type":"ContainerDied","Data":"1343dc0f1047bbcee35b49eee4e23cf094e87b1b1991fc69e6ec7817d91e1a3d"}
Oct 31 13:15:41.905278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.905072    4958 scope.go:122] "RemoveContainer" containerID="efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"
Oct 31 13:15:41.907370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.907332    4958 generic.go:356] "Generic (PLEG): container finished" podID="2fe0a300-d496-4950-9247-6a143646d313" containerID="c589084f6150c563f6fb8220bd7256ce3a3b7347c0d4abad02c1a1b08646c15d" exitCode=0
Oct 31 13:15:41.907508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.907474    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" event={"ID":"2fe0a300-d496-4950-9247-6a143646d313","Type":"ContainerDied","Data":"c589084f6150c563f6fb8220bd7256ce3a3b7347c0d4abad02c1a1b08646c15d"}
Oct 31 13:15:41.918657 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.918632    4958 scope.go:122] "RemoveContainer" containerID="efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"
Oct 31 13:15:41.919055 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:41.919031    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c\": container with ID starting with efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c not found: ID does not exist" containerID="efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"
Oct 31 13:15:41.919164 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.919067    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c"} err="failed to get container status \"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c\": rpc error: code = NotFound desc = could not find container \"efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c\": container with ID starting with efe5059d5029d457647c8823cd78417bd30e4491ecefc1b915c6c49308f6dd8c not found: ID does not exist"
Oct 31 13:15:41.942616 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.942560    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:15:41.945359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:41.945330    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a2c006-7c749fb7bf-m7h5j"]
Oct 31 13:15:42.082440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.082409    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:15:42.096698 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.096647    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\" (UniqueName: \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\") pod \"2fe0a300-d496-4950-9247-6a143646d313\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") "
Oct 31 13:15:42.096877 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.096789    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\") pod \"2fe0a300-d496-4950-9247-6a143646d313\" (UID: \"2fe0a300-d496-4950-9247-6a143646d313\") "
Oct 31 13:15:42.097527 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.097454    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume" pod "2fe0a300-d496-4950-9247-6a143646d313" (UID: "2fe0a300-d496-4950-9247-6a143646d313"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:42.097977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.097944    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe0a300-d496-4950-9247-6a143646d313-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:42.099560 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.099535    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52" pod "2fe0a300-d496-4950-9247-6a143646d313" (UID: "2fe0a300-d496-4950-9247-6a143646d313"). InnerVolumeSpecName "kube-api-access-nlj52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:42.111063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.111023    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:42.199634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.199523    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlj52\" (UniqueName: \"kubernetes.io/projected/2fe0a300-d496-4950-9247-6a143646d313-kube-api-access-nlj52\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:42.494095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.494051    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" path="/var/lib/kubelet/pods/e4e3ef82-cab7-4a86-9377-d7f18fcb3b04/volumes"
Oct 31 13:15:42.926297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.926193    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8" event={"ID":"2fe0a300-d496-4950-9247-6a143646d313","Type":"ContainerDied","Data":"f49791dc053c8a50704d518eb8b7b2127333167cd12c1804dbdc1856ea35c092"}
Oct 31 13:15:42.926297 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.926274    4958 scope.go:122] "RemoveContainer" containerID="c589084f6150c563f6fb8220bd7256ce3a3b7347c0d4abad02c1a1b08646c15d"
Oct 31 13:15:42.926862 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.926397    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"
Oct 31 13:15:42.967367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.967330    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:15:42.974337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:42.974300    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a2c006-84d458dd75-svvn8"]
Oct 31 13:15:43.165934 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:43.165860    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing" containerID="cri-o://1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211" gracePeriod=25
Oct 31 13:15:43.254664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:43.252474    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:43.567205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:43.567115    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:43.943915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:43.943826    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.159443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.159405    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.310346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.310301    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.462069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.462033    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.498717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.498679    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fe0a300-d496-4950-9247-6a143646d313" path="/var/lib/kubelet/pods/2fe0a300-d496-4950-9247-6a143646d313/volumes"
Oct 31 13:15:44.697662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.665938    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.822985 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.822823    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:44.845735 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:15:44.843993    4958 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86b4232_8744_4027_8186_5adb07edc9ce.slice/crio-d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c6e028_102a_45a8_81c1_4fff8c6a3704.slice/crio-448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86b4232_8744_4027_8186_5adb07edc9ce.slice/crio-conmon-d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c6e028_102a_45a8_81c1_4fff8c6a3704.slice/crio-conmon-448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fae6b7_5dd9_4a0b_b8a6_addaceeb70da.slice/crio-19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd.scope\": RecentStats: unable to find data in memory cache]"
Oct 31 13:15:44.963278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.963206    4958 generic.go:356] "Generic (PLEG): container finished" podID="f86b4232-8744-4027-8186-5adb07edc9ce" containerID="d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52" exitCode=0
Oct 31 13:15:44.963862 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.963419    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" event={"ID":"f86b4232-8744-4027-8186-5adb07edc9ce","Type":"ContainerDied","Data":"d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52"}
Oct 31 13:15:44.975841 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.965846    4958 generic.go:356] "Generic (PLEG): container finished" podID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerID="448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8" exitCode=0
Oct 31 13:15:44.975841 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.965998    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" event={"ID":"86c6e028-102a-45a8-81c1-4fff8c6a3704","Type":"ContainerDied","Data":"448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8"}
Oct 31 13:15:44.975841 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.968424    4958 generic.go:356] "Generic (PLEG): container finished" podID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerID="19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd" exitCode=0
Oct 31 13:15:44.975841 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.968545    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" event={"ID":"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da","Type":"ContainerDied","Data":"19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd"}
Oct 31 13:15:44.992032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:44.991958    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:45.014035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.013987    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 13:15:45.014251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.014063    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 13:15:45.320834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.320623    4958 patch_prober.go:29] interesting pod/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 13:15:45.320834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.320697    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 13:15:45.436434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.434645    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:45.541690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.541261    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:15:45.592171 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592092    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592171 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592152    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592183    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592255    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592348 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592330    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592374    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592415    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592555    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.592685 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.592669    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\") pod \"86c6e028-102a-45a8-81c1-4fff8c6a3704\" (UID: \"86c6e028-102a-45a8-81c1-4fff8c6a3704\") "
Oct 31 13:15:45.594567 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.594526    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.594744 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.594687    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:45.594820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.594778    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.594875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.594832    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.596104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.596069    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.596794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.596670    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "kube-api-access-ljcgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.597039 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.596991    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.598387 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.598002    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:15:45.599506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.599478    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token" pod "86c6e028-102a-45a8-81c1-4fff8c6a3704" (UID: "86c6e028-102a-45a8-81c1-4fff8c6a3704"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.617335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.617285    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:15:45.623823 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.623786    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:15:45.649713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.649674    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:15:45.668804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.668768    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:15:45.677207 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.677168    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.696476    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.696702    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.696810    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697459    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697484    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljcgp\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-kube-api-access-ljcgp\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697499    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697512    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697525    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697538    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697551    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697564    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86c6e028-102a-45a8-81c1-4fff8c6a3704-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.697577    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86c6e028-102a-45a8-81c1-4fff8c6a3704-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.698292    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.698344    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"]
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699367    4958 cpu_manager.go:414] "containerMap: removing container" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699392    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699415    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699423    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699435    4958 cpu_manager.go:414] "containerMap: removing container" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699442    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699454    4958 cpu_manager.go:414] "containerMap: removing container" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699462    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699475    4958 cpu_manager.go:414] "containerMap: removing container" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699483    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699503    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699511    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699521    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f9833e49-dc30-40cd-af38-830f607dc68d" containerName="revoke-keys"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699528    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9833e49-dc30-40cd-af38-830f607dc68d" containerName="revoke-keys"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699542    4958 cpu_manager.go:414] "containerMap: removing container" podUID="bd3683c7-fd58-47ea-a551-e3a341947f7a" containerName="maas-api"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699550    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd3683c7-fd58-47ea-a551-e3a341947f7a" containerName="maas-api"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699561    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699567    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699583    4958 cpu_manager.go:414] "containerMap: removing container" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699589    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.699974    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700073    4958 cpu_manager.go:414] "containerMap: removing container" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700085    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700113    4958 cpu_manager.go:414] "containerMap: removing container" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700121    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700151    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700158    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700170    4958 cpu_manager.go:414] "containerMap: removing container" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700177    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700198    4958 cpu_manager.go:414] "containerMap: removing container" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700207    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700218    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.700246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700224    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700423    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700435    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="2fe0a300-d496-4950-9247-6a143646d313" containerName="payload-pre-processing"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700445    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700455    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ac16359-9bac-4b04-926b-517e4bb611c6" containerName="payload-pre-processing"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700470    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700480    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4e3ef82-cab7-4a86-9377-d7f18fcb3b04" containerName="payload-processing"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700489    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" containerName="istio-proxy"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700498    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="86f66737-e1d1-47d9-98b9-72e115fc780e" containerName="payload-processing"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700508    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf52c40f-75af-4a67-8f9f-79fb782ff439" containerName="main"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700516    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" containerName="istio-proxy"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700524    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9833e49-dc30-40cd-af38-830f607dc68d" containerName="revoke-keys"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700534    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd3683c7-fd58-47ea-a551-e3a341947f7a" containerName="maas-api"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700543    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700554    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab70d256-8f3f-4cc5-acde-8085b20c0e1a" containerName="main"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700566    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" containerName="istio-proxy"
Oct 31 13:15:45.702587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.700712    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:15:45.707757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.707024    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"]
Oct 31 13:15:45.707757 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.707151    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:45.716475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.716246    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:15:45.716475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.716440    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:15:45.798222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798189    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798244    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798267    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798284    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798309    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798347    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798376    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798428    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798461    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798477    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798496    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798541    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798586    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798639    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:45.798840 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798623    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.799187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798860    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.799187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798874    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.799187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798959    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\") pod \"f86b4232-8744-4027-8186-5adb07edc9ce\" (UID: \"f86b4232-8744-4027-8186-5adb07edc9ce\") "
Oct 31 13:15:45.799187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799002    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\") pod \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\" (UID: \"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da\") "
Oct 31 13:15:45.799389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.798961    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:45.799868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799842    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f86b4232-8744-4027-8186-5adb07edc9ce-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799873    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799890    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799904    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f86b4232-8744-4027-8186-5adb07edc9ce-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799918    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799931    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.799986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799945    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.800287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799960    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.800287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799064    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.800287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799073    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.800287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.799264    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.801220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801186    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "kube-api-access-nt4s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.801533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801501    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:15:45.801812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801713    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.801812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801734    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.801812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801804    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.801998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.801831    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc" pod "f86b4232-8744-4027-8186-5adb07edc9ce" (UID: "f86b4232-8744-4027-8186-5adb07edc9ce"). InnerVolumeSpecName "kube-api-access-8bfxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:45.802069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.802052    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy" pod "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" (UID: "95fae6b7-5dd9-4a0b-b8a6-addaceeb70da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:45.832533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.832489    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:45.902888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.902788    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:45.902888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.902878    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrrzk\" (UniqueName: \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:45.903190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.902951    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:45.903190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903149    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903169    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903184    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903198    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903211    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bfxc\" (UniqueName: \"kubernetes.io/projected/f86b4232-8744-4027-8186-5adb07edc9ce-kube-api-access-8bfxc\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903228    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f86b4232-8744-4027-8186-5adb07edc9ce-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903241    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903259    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903274    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt4s8\" (UniqueName: \"kubernetes.io/projected/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-kube-api-access-nt4s8\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.903390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.903290    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:45.966032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.965982    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing" containerID="cri-o://b0e9aaeff09d38bddb1d6cf9b373f53a2c9ae0f1d17b2aeec4fa2f21dd2a81d4" gracePeriod=25
Oct 31 13:15:45.978574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.978545    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"
Oct 31 13:15:45.978574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.978564    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6" event={"ID":"86c6e028-102a-45a8-81c1-4fff8c6a3704","Type":"ContainerDied","Data":"fcb359f8e2d663a65db7abfb6c251cc46a77c7f2a6ff2b9d754410feb2f300de"}
Oct 31 13:15:45.978831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.978663    4958 scope.go:122] "RemoveContainer" containerID="448582f3302101826ef29951b1c3b37a8d5c1f8b1c70cba841f854c27c8321c8"
Oct 31 13:15:45.980489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.980471    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"
Oct 31 13:15:45.980747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.980524    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf" event={"ID":"95fae6b7-5dd9-4a0b-b8a6-addaceeb70da","Type":"ContainerDied","Data":"7c6f39c05db2c5250a8a804abd11857de15e69997a69364bea610189746a67a8"}
Oct 31 13:15:45.986790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.985460    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing" containerID="cri-o://9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee" gracePeriod=25
Oct 31 13:15:45.998332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.998297    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf" event={"ID":"f86b4232-8744-4027-8186-5adb07edc9ce","Type":"ContainerDied","Data":"e8f99cac56a9e6580db26a499f728106a194cac0494ffb159fd77e2948162d48"}
Oct 31 13:15:45.998537 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:45.998506    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"
Oct 31 13:15:46.004363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.004337    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.004507 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.004393    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrrzk\" (UniqueName: \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.004507 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.004428    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.007003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.006977    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.007742 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.007714    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.009622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.009586    4958 scope.go:122] "RemoveContainer" containerID="19d69438b5213c454b3b3d90d8331f5d63b8d55d11e573b9b6071da2d9fda8fd"
Oct 31 13:15:46.020779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.020717    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:15:46.033804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.033763    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrrzk\" (UniqueName: \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\") pod \"maas-api-revoke-sub-50a39045-f24t7\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.037761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.037731    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-lkxs6"]
Oct 31 13:15:46.039124 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.039103    4958 scope.go:122] "RemoveContainer" containerID="d5344060c2f7c065a387a123f4d47a4aa33ae5324d182b8a964de0e548fc8d52"
Oct 31 13:15:46.053161 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.052836    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:46.084977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.084939    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:46.095773 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.095738    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:15:46.109845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.103154    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-cb9wf"]
Oct 31 13:15:46.114482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.114446    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:15:46.121099 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.119836    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f9e24f-openshift-default-f747b9cbc-kdmxf"]
Oct 31 13:15:46.408053 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:15:46.407994    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c58ced_45ef_498d_b1f7_82247540130b.slice/crio-a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3 WatchSource:0}: Error finding container a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3: Status 404 returned error can't find the container with id a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3
Oct 31 13:15:46.409020 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.408990    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"]
Oct 31 13:15:46.493294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.493260    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86c6e028-102a-45a8-81c1-4fff8c6a3704" path="/var/lib/kubelet/pods/86c6e028-102a-45a8-81c1-4fff8c6a3704/volumes"
Oct 31 13:15:46.493812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.493797    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95fae6b7-5dd9-4a0b-b8a6-addaceeb70da" path="/var/lib/kubelet/pods/95fae6b7-5dd9-4a0b-b8a6-addaceeb70da/volumes"
Oct 31 13:15:46.494267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:46.494254    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f86b4232-8744-4027-8186-5adb07edc9ce" path="/var/lib/kubelet/pods/f86b4232-8744-4027-8186-5adb07edc9ce/volumes"
Oct 31 13:15:47.011548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:47.011449    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7" event={"ID":"d0c58ced-45ef-498d-b1f7-82247540130b","Type":"ContainerStarted","Data":"303802075ac8c7ac34d0e62085d8c699dcc42802efe704e439fe7b06ed0c1aad"}
Oct 31 13:15:47.011548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:47.011508    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7" event={"ID":"d0c58ced-45ef-498d-b1f7-82247540130b","Type":"ContainerStarted","Data":"a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3"}
Oct 31 13:15:47.040796 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:47.040731    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7" podStartSLOduration=2.040716107 podStartE2EDuration="2.040716107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:15:47.035358772 +0000 UTC m=+968.698784458" watchObservedRunningTime="2026-10-31 13:15:47.040716107 +0000 UTC m=+968.704141791"
Oct 31 13:15:47.246011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:47.245976    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:47.699822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:47.699782    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main" containerID="cri-o://7838f20360f0bc8712161a0e3fb0db590a433bdcdb5bc38e6dcda6601bb5b487" gracePeriod=45
Oct 31 13:15:48.026881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.026844    4958 generic.go:356] "Generic (PLEG): container finished" podID="4156a27d-ce6a-4017-8487-df830915cc9d" containerID="7838f20360f0bc8712161a0e3fb0db590a433bdcdb5bc38e6dcda6601bb5b487" exitCode=0
Oct 31 13:15:48.027437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.026918    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" event={"ID":"4156a27d-ce6a-4017-8487-df830915cc9d","Type":"ContainerDied","Data":"7838f20360f0bc8712161a0e3fb0db590a433bdcdb5bc38e6dcda6601bb5b487"}
Oct 31 13:15:48.029407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.029364    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22" event={"ID":"4156a27d-ce6a-4017-8487-df830915cc9d","Type":"ContainerDied","Data":"fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161"}
Oct 31 13:15:48.029634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.029617    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fafdec8ceccb7247680e24cf100c75f9ddaf8e893c3622ba46dd016ee3af4161"
Oct 31 13:15:48.029772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.029096    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:15:48.030405 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.030284    4958 generic.go:356] "Generic (PLEG): container finished" podID="d0c58ced-45ef-498d-b1f7-82247540130b" containerID="303802075ac8c7ac34d0e62085d8c699dcc42802efe704e439fe7b06ed0c1aad" exitCode=0
Oct 31 13:15:48.030491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.030469    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7" event={"ID":"d0c58ced-45ef-498d-b1f7-82247540130b","Type":"ContainerDied","Data":"303802075ac8c7ac34d0e62085d8c699dcc42802efe704e439fe7b06ed0c1aad"}
Oct 31 13:15:48.146708 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.146593    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.146967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.146931    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:48.147075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.146992    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.147075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147045    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.147145 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147102    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.147190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147166    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\" (UniqueName: \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.147253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147208    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:48.147305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147281    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\" (UniqueName: \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\") pod \"4156a27d-ce6a-4017-8487-df830915cc9d\" (UID: \"4156a27d-ce6a-4017-8487-df830915cc9d\") "
Oct 31 13:15:48.147366 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147312    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:48.147916 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147893    4958 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-model-cache\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.148003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147919    4958 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-home\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.148003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.147935    4958 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-tmp-dir\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.149764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.149735    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:48.149968 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.149944    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:15:48.150073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.149995    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj" pod "4156a27d-ce6a-4017-8487-df830915cc9d" (UID: "4156a27d-ce6a-4017-8487-df830915cc9d"). InnerVolumeSpecName "kube-api-access-756kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:48.249057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.249010    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-756kj\" (UniqueName: \"kubernetes.io/projected/4156a27d-ce6a-4017-8487-df830915cc9d-kube-api-access-756kj\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.249057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.249047    4958 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4156a27d-ce6a-4017-8487-df830915cc9d-dshm\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.249057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.249058    4958 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4156a27d-ce6a-4017-8487-df830915cc9d-tls-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:48.285659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.285596    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:48.434248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:48.434154    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:49.043731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.043688    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"
Oct 31 13:15:49.095898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.094932    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:15:49.100571 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.100529    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-79c6ff/distinct-w6-79c6ff-kserve-74bfdfccd6-p2l22"]
Oct 31 13:15:49.272989 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.272962    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:49.288302 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.288263    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\" (UniqueName: \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\") pod \"d0c58ced-45ef-498d-b1f7-82247540130b\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") "
Oct 31 13:15:49.288481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.288412    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\") pod \"d0c58ced-45ef-498d-b1f7-82247540130b\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") "
Oct 31 13:15:49.288562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.288550    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\") pod \"d0c58ced-45ef-498d-b1f7-82247540130b\" (UID: \"d0c58ced-45ef-498d-b1f7-82247540130b\") "
Oct 31 13:15:49.288914 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.288884    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca" pod "d0c58ced-45ef-498d-b1f7-82247540130b" (UID: "d0c58ced-45ef-498d-b1f7-82247540130b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:15:49.289268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.289235    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:49.292114 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.292088    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca" pod "d0c58ced-45ef-498d-b1f7-82247540130b" (UID: "d0c58ced-45ef-498d-b1f7-82247540130b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:15:49.292287 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.292265    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk" pod "d0c58ced-45ef-498d-b1f7-82247540130b" (UID: "d0c58ced-45ef-498d-b1f7-82247540130b"). InnerVolumeSpecName "kube-api-access-jrrzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:15:49.390358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.390312    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrrzk\" (UniqueName: \"kubernetes.io/projected/d0c58ced-45ef-498d-b1f7-82247540130b-kube-api-access-jrrzk\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:49.390358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.390351    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d0c58ced-45ef-498d-b1f7-82247540130b-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:15:49.393998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.393949    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:49.549552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.549505    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:49.802692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.792279    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:49.931305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:49.931272    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:50.057929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.057824    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7" event={"ID":"d0c58ced-45ef-498d-b1f7-82247540130b","Type":"ContainerDied","Data":"a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3"}
Oct 31 13:15:50.057929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.057847    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"
Oct 31 13:15:50.057929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.057876    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a61551f5dc9d59d3b355f3da4dc8e250d71ae09c01684b92fbf13a975531cdc3"
Oct 31 13:15:50.486299 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.486265    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:50.494734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.494701    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" path="/var/lib/kubelet/pods/4156a27d-ce6a-4017-8487-df830915cc9d/volumes"
Oct 31 13:15:50.814672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.814566    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:15:50.831489 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.831453    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:15:50.869939 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:50.869273    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:51.014758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:51.014719    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:51.220761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:51.212997    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:51.374142 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:51.374104    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:51.580374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:51.580277    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:51.975995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:51.975963    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:52.145779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.145746    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:15:52.146674 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146644    4958 cpu_manager.go:414] "containerMap: removing container" podUID="d0c58ced-45ef-498d-b1f7-82247540130b" containerName="revoke-keys"
Oct 31 13:15:52.146674 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146672    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0c58ced-45ef-498d-b1f7-82247540130b" containerName="revoke-keys"
Oct 31 13:15:52.146674 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146689    4958 cpu_manager.go:414] "containerMap: removing container" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146694    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146733    4958 cpu_manager.go:414] "containerMap: removing container" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146742    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146905    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0c58ced-45ef-498d-b1f7-82247540130b" containerName="revoke-keys"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146922    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e071dbaf-525c-43ba-9acc-e56627dc1f5f" containerName="cleanup"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146931    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="4156a27d-ce6a-4017-8487-df830915cc9d" containerName="main"
Oct 31 13:15:52.146938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.146941    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7453b3e-adf7-4644-9e92-2c9a77da4dce" containerName="cleanup"
Oct 31 13:15:52.152298 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.152274    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.172505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.172471    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:15:52.266523 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266407    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266590    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266639    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266734    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266779    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266807    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9x88\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.266967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.266870    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.267195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.267005    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.267195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.267088    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369151 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369099    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369209    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369304    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369506    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369621 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369545    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369621 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369582    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369643    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369669    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9x88\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.369735 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369701    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.370011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.369936    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.370703 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.370164    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.370703 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.370198    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.370703 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.370671    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.371160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.371140    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.372450 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.372420    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.372863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.372844    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.392455 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.392417    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.392587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.392561    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9x88\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\") pod \"e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") " pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.470556 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.470519    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:52.564769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.564087    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:52.793352 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.793220    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:15:52.802938 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:15:52.802905    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57121605_f2c9_4d15_b7f8_ce8d688f712c.slice/crio-3b29ba583279862a9e02d202b530ef4ae0bc97db5f3878b223dd4ed4b8fa15df WatchSource:0}: Error finding container 3b29ba583279862a9e02d202b530ef4ae0bc97db5f3878b223dd4ed4b8fa15df: Status 404 returned error can't find the container with id 3b29ba583279862a9e02d202b530ef4ae0bc97db5f3878b223dd4ed4b8fa15df
Oct 31 13:15:52.805463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.805426    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:15:52.805549 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.805496    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:15:52.805549 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.805525    4958 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 13:15:52.942657 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:52.936975    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:53.086890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.086782    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" event={"ID":"57121605-f2c9-4d15-b7f8-ce8d688f712c","Type":"ContainerStarted","Data":"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"}
Oct 31 13:15:53.086890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.086850    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" event={"ID":"57121605-f2c9-4d15-b7f8-ce8d688f712c","Type":"ContainerStarted","Data":"3b29ba583279862a9e02d202b530ef4ae0bc97db5f3878b223dd4ed4b8fa15df"}
Oct 31 13:15:53.122846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.122769    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podStartSLOduration=1.122747417 podStartE2EDuration="1.122747417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:15:53.114666767 +0000 UTC m=+974.778092472" watchObservedRunningTime="2026-10-31 13:15:53.122747417 +0000 UTC m=+974.786173102"
Oct 31 13:15:53.471143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.471104    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:15:53.473622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.473571    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:53.473764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.473672    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:53.567894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:53.567825    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:54.035628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.018028    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:54.187813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.176129    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:54.501720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.488286    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:54.501720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.488343    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:54.523636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.519161    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:54.554400 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.547390    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:15:54.554400 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:54.547885    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" containerID="cri-o://bf98354219e9d9299684f8598f11c012deca5fa64223ce3cb3b080a2b9269ada" gracePeriod=30
Oct 31 13:15:55.483627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.482640    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:55.483627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.482720    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:55.689635 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.687674    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:15:55.750802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.745620    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:15:55.829653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.825592    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing" containerID="cri-o://ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c" gracePeriod=25
Oct 31 13:15:55.849632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.841693    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing" containerID="cri-o://fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb" gracePeriod=25
Oct 31 13:15:56.030457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:55.880625    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:56.358688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:56.358349    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:56.816631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:56.803772    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:56.816631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:56.803853    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:56.816631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:56.804770    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:56.861632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:56.825732    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:57.416454 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.416405    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:57.503396 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.503357    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:57.503691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.503657    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:57.594646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.582858    4958 patch_prober.go:29] interesting pod/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:15:57.594646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.582928    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:15:57.654270 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.653526    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:57.852948 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.835834    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:57.921884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:57.892483    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:15:58.046676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.042664    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 13:15:58.046676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.044197    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:58.664472 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.664412    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:58.665239 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.664668    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:58.752632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.742058    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:15:58.907629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.858075    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:58.927698 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:58.913147    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:59.044902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.044858    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:15:59.215942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.215626    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:15:59.293944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.293539    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:15:59.296601 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.296565    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:59.525162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.525057    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:15:59.525444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.525406    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:15:59.673683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.673641    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:15:59.679655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:15:59.679598    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:00.052684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.043136    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:00.052684 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:00.047777    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:16:00.140633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.135779    4958 generic.go:356] "Generic (PLEG): container finished" podID="1593a303-7a9f-48b8-a063-faafeed228a8" containerID="bf98354219e9d9299684f8598f11c012deca5fa64223ce3cb3b080a2b9269ada" exitCode=0
Oct 31 13:16:00.140633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.135948    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" event={"ID":"1593a303-7a9f-48b8-a063-faafeed228a8","Type":"ContainerDied","Data":"bf98354219e9d9299684f8598f11c012deca5fa64223ce3cb3b080a2b9269ada"}
Oct 31 13:16:00.276194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.276057    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:00.404522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.404496    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:16:00.472705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.472663    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:16:00.472902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.472734    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:16:00.586527 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586481    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586551    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586582    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586722    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586808    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586889    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.586978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.586954    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:00.587030 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587011    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.587122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587105    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.587196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587181    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\") pod \"1593a303-7a9f-48b8-a063-faafeed228a8\" (UID: \"1593a303-7a9f-48b8-a063-faafeed228a8\") "
Oct 31 13:16:00.587242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587223    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:00.587829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587806    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.587829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.587827    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.588112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.588088    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:00.588640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.588545    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:00.589120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.589089    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:00.592789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.592643    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:00.592789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.592688    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:00.593380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.593350    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:00.594092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.594052    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4" pod "1593a303-7a9f-48b8-a063-faafeed228a8" (UID: "1593a303-7a9f-48b8-a063-faafeed228a8"). InnerVolumeSpecName "kube-api-access-nsxr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:00.688728 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.688594    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing" containerID="cri-o://64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d" gracePeriod=25
Oct 31 13:16:00.689714 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689680    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689716    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsxr4\" (UniqueName: \"kubernetes.io/projected/1593a303-7a9f-48b8-a063-faafeed228a8-kube-api-access-nsxr4\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689733    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689748    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689764    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1593a303-7a9f-48b8-a063-faafeed228a8-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689779    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1593a303-7a9f-48b8-a063-faafeed228a8-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.689812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.689793    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1593a303-7a9f-48b8-a063-faafeed228a8-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:00.691820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.691782    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" containerID="cri-o://3826b1c11724273a4de7ef86089977494e2a7a693ce3e4e78111396970523ae5" gracePeriod=45
Oct 31 13:16:00.699987 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.699946    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": read tcp 10.132.0.2:54106->10.132.0.85:8000: read: connection reset by peer"
Oct 31 13:16:00.713031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.712985    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" containerID="cri-o://fab9d6c731b206c61fe87999ee8ec03f37fc8797de8b92954d7c7aa4e9d50269" gracePeriod=45
Oct 31 13:16:00.752959 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.748689    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing" containerID="cri-o://c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327" gracePeriod=25
Oct 31 13:16:00.994747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.994708    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:16:00.995260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:00.995223    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" podUID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" containerName="maas-api" containerID="cri-o://a83c571752b77a1646595332be8e9af57294726755eae620dafe6aad7c6d4d16" gracePeriod=30
Oct 31 13:16:01.086396 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.076193    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:01.175716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.175460    4958 generic.go:356] "Generic (PLEG): container finished" podID="cedd26c4-de10-4701-88ce-819467dd3c05" containerID="3826b1c11724273a4de7ef86089977494e2a7a693ce3e4e78111396970523ae5" exitCode=0
Oct 31 13:16:01.175716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.175647    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" event={"ID":"cedd26c4-de10-4701-88ce-819467dd3c05","Type":"ContainerDied","Data":"3826b1c11724273a4de7ef86089977494e2a7a693ce3e4e78111396970523ae5"}
Oct 31 13:16:01.177910 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.177882    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"
Oct 31 13:16:01.178268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.177881    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9" event={"ID":"1593a303-7a9f-48b8-a063-faafeed228a8","Type":"ContainerDied","Data":"cc28cceab0ec89915c040154ad2c3a84823b4c3964a7b998076244c5f4bd5685"}
Oct 31 13:16:01.178268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.178131    4958 scope.go:122] "RemoveContainer" containerID="bf98354219e9d9299684f8598f11c012deca5fa64223ce3cb3b080a2b9269ada"
Oct 31 13:16:01.183356 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.183201    4958 generic.go:356] "Generic (PLEG): container finished" podID="f9940156-4289-4652-a1cc-29538fb10f5c" containerID="fab9d6c731b206c61fe87999ee8ec03f37fc8797de8b92954d7c7aa4e9d50269" exitCode=0
Oct 31 13:16:01.183356 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.183294    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" event={"ID":"f9940156-4289-4652-a1cc-29538fb10f5c","Type":"ContainerDied","Data":"fab9d6c731b206c61fe87999ee8ec03f37fc8797de8b92954d7c7aa4e9d50269"}
Oct 31 13:16:01.186909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.186644    4958 generic.go:356] "Generic (PLEG): container finished" podID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" containerID="a83c571752b77a1646595332be8e9af57294726755eae620dafe6aad7c6d4d16" exitCode=0
Oct 31 13:16:01.186909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.186811    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" event={"ID":"a918740e-9f94-483b-8837-6ccd8ae2a6a0","Type":"ContainerDied","Data":"a83c571752b77a1646595332be8e9af57294726755eae620dafe6aad7c6d4d16"}
Oct 31 13:16:01.283278 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.276707    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:16:01.429151 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.427346    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a2c006-openshift-default-585cfbf5b7-5wzz9"]
Oct 31 13:16:01.538705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.534807    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:16:01.538705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.534894    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:16:01.562138 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.562097    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:01.570392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.570343    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:01.573890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.573841    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:01.574343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.574319    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:01.583601 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.583576    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:16:01.664893 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.661457    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:16:01.681229 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.681191    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.681476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.681459    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.681679 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.681664    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.681977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.681956    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.682161 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682146    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\" (UniqueName: \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.682294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682281    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.682411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682397    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\" (UniqueName: \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.682510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682494    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\" (UniqueName: \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.682637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682601    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.682829 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682813    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\") pod \"f9940156-4289-4652-a1cc-29538fb10f5c\" (UID: \"f9940156-4289-4652-a1cc-29538fb10f5c\") "
Oct 31 13:16:01.682959 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.682946    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.683070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.683058    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\") pod \"cedd26c4-de10-4701-88ce-819467dd3c05\" (UID: \"cedd26c4-de10-4701-88ce-819467dd3c05\") "
Oct 31 13:16:01.685096 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.685069    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.687656 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.687630    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.688099 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.688076    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.688413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.688395    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.688995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.688960    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.693648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.693598    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.708809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.708531    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.708809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.708542    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:01.708809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.708616    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:01.708809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.708634    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "kube-api-access-bzpll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:01.708809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.708663    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n" pod "cedd26c4-de10-4701-88ce-819467dd3c05" (UID: "cedd26c4-de10-4701-88ce-819467dd3c05"). InnerVolumeSpecName "kube-api-access-pdb9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:01.709304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.709281    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm" pod "f9940156-4289-4652-a1cc-29538fb10f5c" (UID: "f9940156-4289-4652-a1cc-29538fb10f5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:01.742812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.740931    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:01.797280 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.797178    4958 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-tmp-dir\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.797497 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.797482    4958 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-dshm\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.797590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.797578    4958 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-tmp-dir\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.797801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.797767    4958 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-model-cache\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.811471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.811439    4958 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cedd26c4-de10-4701-88ce-819467dd3c05-tls-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.811699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.811680    4958 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9940156-4289-4652-a1cc-29538fb10f5c-home\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.811819 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.811804    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzpll\" (UniqueName: \"kubernetes.io/projected/f9940156-4289-4652-a1cc-29538fb10f5c-kube-api-access-bzpll\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.811923 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.811908    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdb9n\" (UniqueName: \"kubernetes.io/projected/cedd26c4-de10-4701-88ce-819467dd3c05-kube-api-access-pdb9n\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.812020 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.812008    4958 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-model-cache\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.812133 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.812113    4958 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9940156-4289-4652-a1cc-29538fb10f5c-tls-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.812243 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.812227    4958 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-home\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.812321 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.812311    4958 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cedd26c4-de10-4701-88ce-819467dd3c05-dshm\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:01.986910 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:01.986872    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:16:02.120892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.120765    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") pod \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") "
Oct 31 13:16:02.122152 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.121761    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\") pod \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") "
Oct 31 13:16:02.122336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.122116    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca" pod "a918740e-9f94-483b-8837-6ccd8ae2a6a0" (UID: "a918740e-9f94-483b-8837-6ccd8ae2a6a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:02.122336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.122196    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\" (UniqueName: \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\") pod \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") "
Oct 31 13:16:02.122677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.122656    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\") pod \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\" (UID: \"a918740e-9f94-483b-8837-6ccd8ae2a6a0\") "
Oct 31 13:16:02.123788 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.123765    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a918740e-9f94-483b-8837-6ccd8ae2a6a0-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:02.124767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.124710    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls" pod "a918740e-9f94-483b-8837-6ccd8ae2a6a0" (UID: "a918740e-9f94-483b-8837-6ccd8ae2a6a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:02.124917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.124889    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh" pod "a918740e-9f94-483b-8837-6ccd8ae2a6a0" (UID: "a918740e-9f94-483b-8837-6ccd8ae2a6a0"). InnerVolumeSpecName "kube-api-access-2rjvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:02.126794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.126765    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs" pod "a918740e-9f94-483b-8837-6ccd8ae2a6a0" (UID: "a918740e-9f94-483b-8837-6ccd8ae2a6a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:02.203961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.203934    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"
Oct 31 13:16:02.204415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.203971    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8" event={"ID":"a918740e-9f94-483b-8837-6ccd8ae2a6a0","Type":"ContainerDied","Data":"214e93beb64e90c4890feb2ec5d0b8a879f1ded22948fd350e8b273c2e5266cb"}
Oct 31 13:16:02.204415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.204282    4958 scope.go:122] "RemoveContainer" containerID="a83c571752b77a1646595332be8e9af57294726755eae620dafe6aad7c6d4d16"
Oct 31 13:16:02.206965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.206005    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"
Oct 31 13:16:02.206965 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.206115    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg" event={"ID":"cedd26c4-de10-4701-88ce-819467dd3c05","Type":"ContainerDied","Data":"068235787f531fc663a55445ff8f3239c334e49e5a667d6616aeb2e8cb60f1a9"}
Oct 31 13:16:02.211224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.211190    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" event={"ID":"f9940156-4289-4652-a1cc-29538fb10f5c","Type":"ContainerDied","Data":"43b0ffc8278e6f8accd9aac365cf40f236ee266b8fcad100170782fb850b88a2"}
Oct 31 13:16:02.211358 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.211250    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"
Oct 31 13:16:02.224646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.224203    4958 scope.go:122] "RemoveContainer" containerID="3826b1c11724273a4de7ef86089977494e2a7a693ce3e4e78111396970523ae5"
Oct 31 13:16:02.227827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.226955    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:02.227827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.226985    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rjvh\" (UniqueName: \"kubernetes.io/projected/a918740e-9f94-483b-8837-6ccd8ae2a6a0-kube-api-access-2rjvh\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:02.227827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.227001    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a918740e-9f94-483b-8837-6ccd8ae2a6a0-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:02.263643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.262873    4958 scope.go:122] "RemoveContainer" containerID="fab9d6c731b206c61fe87999ee8ec03f37fc8797de8b92954d7c7aa4e9d50269"
Oct 31 13:16:02.284277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.284235    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:16:02.290368 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.289784    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9"]
Oct 31 13:16:02.302538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.302499    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:16:02.313111 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.313056    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-004f64/distinct-w3-004f64-kserve-5f8565b54-4mrwg"]
Oct 31 13:16:02.339753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.339683    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:16:02.345969 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.345934    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-2a262a-5b5989cc99-jcrp8"]
Oct 31 13:16:02.350453 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.350420    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:02.471391 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.471353    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 31 13:16:02.471577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.471437    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 31 13:16:02.492588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.492551    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" path="/var/lib/kubelet/pods/1593a303-7a9f-48b8-a063-faafeed228a8/volumes"
Oct 31 13:16:02.493196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.493172    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" path="/var/lib/kubelet/pods/a918740e-9f94-483b-8837-6ccd8ae2a6a0/volumes"
Oct 31 13:16:02.493749 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.493728    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" path="/var/lib/kubelet/pods/cedd26c4-de10-4701-88ce-819467dd3c05/volumes"
Oct 31 13:16:02.494573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.494550    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" path="/var/lib/kubelet/pods/f9940156-4289-4652-a1cc-29538fb10f5c/volumes"
Oct 31 13:16:02.572643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.572580    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:02.607619 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.607562    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-004f64/premium-w3-004f64-kserve-5c74d6cbc9-mqwl9" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:16:02.942193 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:02.942099    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.044631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.044261    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:16:03.044631 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.044546    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" podUID="61d26977-831b-4a07-a5b5-dad023202527" containerName="maas-api" containerID="cri-o://2d52216caea4bd2d3d89e967f2643ae4bd3931e61757f2d2d59cb1ace4334be3" gracePeriod=30
Oct 31 13:16:03.118244 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.118209    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.232647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.232294    4958 generic.go:356] "Generic (PLEG): container finished" podID="61d26977-831b-4a07-a5b5-dad023202527" containerID="2d52216caea4bd2d3d89e967f2643ae4bd3931e61757f2d2d59cb1ace4334be3" exitCode=0
Oct 31 13:16:03.232647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.232553    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" event={"ID":"61d26977-831b-4a07-a5b5-dad023202527","Type":"ContainerDied","Data":"2d52216caea4bd2d3d89e967f2643ae4bd3931e61757f2d2d59cb1ace4334be3"}
Oct 31 13:16:03.269853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.268768    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.478667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.461307    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.619657 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:16:03.614228    4958 logging.go:55] [core] [Channel #1298 SubChannel #1299]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.79:50052", ServerName: "10.132.0.79:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.79:50052: connect: connection refused"
Oct 31 13:16:03.676900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.674740    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:16:03.703021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.702854    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.856194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.855635    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\") pod \"61d26977-831b-4a07-a5b5-dad023202527\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") "
Oct 31 13:16:03.856194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.855705    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\" (UniqueName: \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\") pod \"61d26977-831b-4a07-a5b5-dad023202527\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") "
Oct 31 13:16:03.856194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.855757    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\") pod \"61d26977-831b-4a07-a5b5-dad023202527\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") "
Oct 31 13:16:03.856194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.855930    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\") pod \"61d26977-831b-4a07-a5b5-dad023202527\" (UID: \"61d26977-831b-4a07-a5b5-dad023202527\") "
Oct 31 13:16:03.858158 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.857048    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca" pod "61d26977-831b-4a07-a5b5-dad023202527" (UID: "61d26977-831b-4a07-a5b5-dad023202527"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:03.890546 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.888363    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs" pod "61d26977-831b-4a07-a5b5-dad023202527" (UID: "61d26977-831b-4a07-a5b5-dad023202527"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:03.890546 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.888461    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl" pod "61d26977-831b-4a07-a5b5-dad023202527" (UID: "61d26977-831b-4a07-a5b5-dad023202527"). InnerVolumeSpecName "kube-api-access-cpvgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:03.890546 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.888533    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls" pod "61d26977-831b-4a07-a5b5-dad023202527" (UID: "61d26977-831b-4a07-a5b5-dad023202527"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:03.892384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.891280    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:03.911481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.911450    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:16:03.980681 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.980648    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d26977-831b-4a07-a5b5-dad023202527-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:03.980998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.980971    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:03.981186 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.981168    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpvgl\" (UniqueName: \"kubernetes.io/projected/61d26977-831b-4a07-a5b5-dad023202527-kube-api-access-cpvgl\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:03.981279 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:03.981267    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61d26977-831b-4a07-a5b5-dad023202527-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:04.081936 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.081899    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\" (UniqueName: \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\") pod \"35981ba1-2c78-41ef-a7ca-c16952d72669\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") "
Oct 31 13:16:04.082125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.081964    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\") pod \"35981ba1-2c78-41ef-a7ca-c16952d72669\" (UID: \"35981ba1-2c78-41ef-a7ca-c16952d72669\") "
Oct 31 13:16:04.082855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.082816    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume" pod "35981ba1-2c78-41ef-a7ca-c16952d72669" (UID: "35981ba1-2c78-41ef-a7ca-c16952d72669"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:04.103727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.103223    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv" pod "35981ba1-2c78-41ef-a7ca-c16952d72669" (UID: "35981ba1-2c78-41ef-a7ca-c16952d72669"). InnerVolumeSpecName "kube-api-access-bslxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:04.183710 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.183663    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35981ba1-2c78-41ef-a7ca-c16952d72669-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:04.183710 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.183708    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bslxv\" (UniqueName: \"kubernetes.io/projected/35981ba1-2c78-41ef-a7ca-c16952d72669-kube-api-access-bslxv\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:04.249591 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.249513    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:04.257014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.256981    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"
Oct 31 13:16:04.257210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.256985    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm" event={"ID":"61d26977-831b-4a07-a5b5-dad023202527","Type":"ContainerDied","Data":"24c78fc14933c1e3225d2cdd1991f2c119e538f882534a7472d3f7c36f35d9ae"}
Oct 31 13:16:04.257210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.257182    4958 scope.go:122] "RemoveContainer" containerID="2d52216caea4bd2d3d89e967f2643ae4bd3931e61757f2d2d59cb1ace4334be3"
Oct 31 13:16:04.259541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.259501    4958 generic.go:356] "Generic (PLEG): container finished" podID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerID="1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211" exitCode=0
Oct 31 13:16:04.259697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.259555    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" event={"ID":"35981ba1-2c78-41ef-a7ca-c16952d72669","Type":"ContainerDied","Data":"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"}
Oct 31 13:16:04.259697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.259577    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"
Oct 31 13:16:04.259697 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.259641    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" event={"ID":"35981ba1-2c78-41ef-a7ca-c16952d72669","Type":"ContainerDied","Data":"6a015b027c4097d681424b525440a8fd20cbe3ed5df2f97a35f428d3311f2ddd"}
Oct 31 13:16:04.272273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.272247    4958 scope.go:122] "RemoveContainer" containerID="1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"
Oct 31 13:16:04.283945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.283921    4958 scope.go:122] "RemoveContainer" containerID="1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"
Oct 31 13:16:04.284329 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:04.284306    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211\": container with ID starting with 1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211 not found: ID does not exist" containerID="1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"
Oct 31 13:16:04.284404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.284342    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211"} err="failed to get container status \"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211\": rpc error: code = NotFound desc = could not find container \"1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211\": container with ID starting with 1ab1b03e31596c5089a42deddbd28237e96953e0e3ab3606dc12db3320085211 not found: ID does not exist"
Oct 31 13:16:04.295731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.295679    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:16:04.297810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.297779    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-426787-74d6fb5485-gzmmm"]
Oct 31 13:16:04.327911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.327856    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:16:04.336906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.336232    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c"]
Oct 31 13:16:04.520632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.519694    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" path="/var/lib/kubelet/pods/35981ba1-2c78-41ef-a7ca-c16952d72669/volumes"
Oct 31 13:16:04.520632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.520513    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61d26977-831b-4a07-a5b5-dad023202527" path="/var/lib/kubelet/pods/61d26977-831b-4a07-a5b5-dad023202527/volumes"
Oct 31 13:16:04.556630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.555712    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:16:04.556630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.555784    4958 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:16:04.595649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:04.576006    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-79c6ff-58879c7685-rc88c" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.79:50052\" within 1s: context deadline exceeded"
Oct 31 13:16:05.398116 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:05.398065    4958 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:16:05.398681 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:05.398660    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:16:05.399647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:05.399593    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:16:05.805786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:05.805752    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:06.282847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.282816    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:16:06.290789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.290751    4958 generic.go:356] "Generic (PLEG): container finished" podID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerID="9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee" exitCode=0
Oct 31 13:16:06.290992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.290814    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"
Oct 31 13:16:06.290992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.290833    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" event={"ID":"9eeed622-73ae-4d52-9985-ea079cac05d9","Type":"ContainerDied","Data":"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"}
Oct 31 13:16:06.290992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.290920    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp" event={"ID":"9eeed622-73ae-4d52-9985-ea079cac05d9","Type":"ContainerDied","Data":"cbefd3b3958766e1103527228eb0178c1127601e4acedb537525fafc8be644a5"}
Oct 31 13:16:06.290992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.290956    4958 scope.go:122] "RemoveContainer" containerID="9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"
Oct 31 13:16:06.293466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.293440    4958 generic.go:356] "Generic (PLEG): container finished" podID="b2169535-a6f1-4888-9ade-adf32976a82a" containerID="b0e9aaeff09d38bddb1d6cf9b373f53a2c9ae0f1d17b2aeec4fa2f21dd2a81d4" exitCode=0
Oct 31 13:16:06.293617 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.293497    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" event={"ID":"b2169535-a6f1-4888-9ade-adf32976a82a","Type":"ContainerDied","Data":"b0e9aaeff09d38bddb1d6cf9b373f53a2c9ae0f1d17b2aeec4fa2f21dd2a81d4"}
Oct 31 13:16:06.307836 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.307774    4958 scope.go:122] "RemoveContainer" containerID="9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"
Oct 31 13:16:06.313073 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:06.311982    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee\": container with ID starting with 9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee not found: ID does not exist" containerID="9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"
Oct 31 13:16:06.313073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.312024    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee"} err="failed to get container status \"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee\": rpc error: code = NotFound desc = could not find container \"9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee\": container with ID starting with 9ac815cd7c85643197d8658853dd1ac0ff3c611767c40f09b14a416b76447aee not found: ID does not exist"
Oct 31 13:16:06.326847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.326769    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:16:06.374557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.374475    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\") pod \"9eeed622-73ae-4d52-9985-ea079cac05d9\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") "
Oct 31 13:16:06.374946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.374921    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\" (UniqueName: \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\") pod \"9eeed622-73ae-4d52-9985-ea079cac05d9\" (UID: \"9eeed622-73ae-4d52-9985-ea079cac05d9\") "
Oct 31 13:16:06.376524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.375082    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume" pod "9eeed622-73ae-4d52-9985-ea079cac05d9" (UID: "9eeed622-73ae-4d52-9985-ea079cac05d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:06.387738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.378598    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq" pod "9eeed622-73ae-4d52-9985-ea079cac05d9" (UID: "9eeed622-73ae-4d52-9985-ea079cac05d9"). InnerVolumeSpecName "kube-api-access-zzqsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:06.476715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.476679    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\" (UniqueName: \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\") pod \"b2169535-a6f1-4888-9ade-adf32976a82a\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") "
Oct 31 13:16:06.476715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.476726    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\") pod \"b2169535-a6f1-4888-9ade-adf32976a82a\" (UID: \"b2169535-a6f1-4888-9ade-adf32976a82a\") "
Oct 31 13:16:06.477300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.477224    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume" pod "b2169535-a6f1-4888-9ade-adf32976a82a" (UID: "b2169535-a6f1-4888-9ade-adf32976a82a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:06.477300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.477232    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eeed622-73ae-4d52-9985-ea079cac05d9-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:06.477300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.477288    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzqsq\" (UniqueName: \"kubernetes.io/projected/9eeed622-73ae-4d52-9985-ea079cac05d9-kube-api-access-zzqsq\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:06.478918 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.478888    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82" pod "b2169535-a6f1-4888-9ade-adf32976a82a" (UID: "b2169535-a6f1-4888-9ade-adf32976a82a"). InnerVolumeSpecName "kube-api-access-8zn82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:06.579084 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.579044    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zn82\" (UniqueName: \"kubernetes.io/projected/b2169535-a6f1-4888-9ade-adf32976a82a-kube-api-access-8zn82\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:06.579084 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.579082    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2169535-a6f1-4888-9ade-adf32976a82a-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:06.611613 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.611561    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:16:06.616779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:06.616744    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-2a262a-59846657cf-gcvqp"]
Oct 31 13:16:07.304300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.304216    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"
Oct 31 13:16:07.304300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.304216    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm" event={"ID":"b2169535-a6f1-4888-9ade-adf32976a82a","Type":"ContainerDied","Data":"9d87c989dc465c8cf6f7dbfdd8d63c812ede9b9010f1edde29bfbdd38956c370"}
Oct 31 13:16:07.304510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.304313    4958 scope.go:122] "RemoveContainer" containerID="b0e9aaeff09d38bddb1d6cf9b373f53a2c9ae0f1d17b2aeec4fa2f21dd2a81d4"
Oct 31 13:16:07.333062 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.333021    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:16:07.339018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.338983    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-2a262a-666dfc9bc5-99jlm"]
Oct 31 13:16:07.712398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.712358    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:07.852702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.852651    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:07.956669 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.956059    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:16:07.960938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.960895    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy" containerID="cri-o://d4fefed1c5a3d83280f540d109fca2943dfc38c12dd8308dc76ddd51150cf82e" gracePeriod=30
Oct 31 13:16:07.962513 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.962405    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:16:07.962731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.962703    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy" containerID="cri-o://4d99cd730794e799021141f0e13679f7231de8669d5cc5d788213a82a310e6c3" gracePeriod=30
Oct 31 13:16:07.978753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.978716    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:16:07.979292 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:07.979247    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy" containerID="cri-o://535f20bb2afb44fd5f08dc26c29f4cf633d76e322ca6828441285c5d2b39290d" gracePeriod=30
Oct 31 13:16:08.031413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:08.031379    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:08.457106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:08.457007    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:08.493057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:08.493013    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" path="/var/lib/kubelet/pods/9eeed622-73ae-4d52-9985-ea079cac05d9/volumes"
Oct 31 13:16:08.493573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:08.493549    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" path="/var/lib/kubelet/pods/b2169535-a6f1-4888-9ade-adf32976a82a/volumes"
Oct 31 13:16:08.870257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:08.870146    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:09.004542 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.004486    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:09.343636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.309760    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:09.450565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.448716    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:16:09.450565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.448805    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:16:09.450565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.449022    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" containerID="cri-o://a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe" gracePeriod=30
Oct 31 13:16:09.450565 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.449317    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy" containerID="cri-o://177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2" gracePeriod=30
Oct 31 13:16:09.483038 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.478925    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:16:09.483038 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.479193    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy" containerID="cri-o://f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55" gracePeriod=30
Oct 31 13:16:09.522632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:09.507561    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:11.279978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.279940    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:11.412511 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.412480    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:11.549804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.549719    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:11.549804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.549743    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 13:16:11.773461 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.773394    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:11.908191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:11.908041    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:12.094426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.094389    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:16:12.094844 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.094820    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:16:12.095112 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.095081    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" containerID="cri-o://f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316" gracePeriod=30
Oct 31 13:16:12.095456 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.095277    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy" containerID="cri-o://341f1a3a04ca18a69378cb90cda415824e6c0e6bed9b6cc2e747cef54b801725" gracePeriod=30
Oct 31 13:16:12.098746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.098688    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:16:12.099069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.099041    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" containerID="cri-o://8e8d493a69235c3bc41fcf505c9723e3f74672bd81b3e63f025278916cdd50b1" gracePeriod=30
Oct 31 13:16:12.135467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.135434    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:12.358376 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.358337    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:12.757871 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.757823    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:12.889481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:12.889445    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:13.086656 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.079108    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:16:13.086656 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.085939    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:16:13.086656 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.086178    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" containerID="cri-o://5ad7dea222a92991ed4e1e6a668c300155e49524a58f950b511c32221ef1b4b8" gracePeriod=30
Oct 31 13:16:13.086656 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.086523    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" containerID="cri-o://adb2ac61fdf79451e47b30985f6689b77308f0ef7ef13c20313e214a0aac66ef" gracePeriod=30
Oct 31 13:16:13.096135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.096027    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:16:13.096277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.096252    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" containerID="cri-o://326e7b3903c6f9b74bfb0b5a6002f4663c97b4f4b54af6c488bf78d1d7dd631c" gracePeriod=30
Oct 31 13:16:13.104072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.104036    4958 patch_prober.go:29] interesting pod/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:13.104210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.104097    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:13.141325 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.141289    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:13.443398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.443296    4958 generic.go:356] "Generic (PLEG): container finished" podID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerID="535f20bb2afb44fd5f08dc26c29f4cf633d76e322ca6828441285c5d2b39290d" exitCode=0
Oct 31 13:16:13.443894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.443383    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" event={"ID":"a621e490-a4d4-4b69-9870-aff6bdad4b56","Type":"ContainerDied","Data":"535f20bb2afb44fd5f08dc26c29f4cf633d76e322ca6828441285c5d2b39290d"}
Oct 31 13:16:13.446143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.446112    4958 generic.go:356] "Generic (PLEG): container finished" podID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerID="d4fefed1c5a3d83280f540d109fca2943dfc38c12dd8308dc76ddd51150cf82e" exitCode=0
Oct 31 13:16:13.446330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.446305    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" event={"ID":"3d796daa-8bc1-481c-87e1-9ef86af9dbfd","Type":"ContainerDied","Data":"d4fefed1c5a3d83280f540d109fca2943dfc38c12dd8308dc76ddd51150cf82e"}
Oct 31 13:16:13.448717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.448685    4958 generic.go:356] "Generic (PLEG): container finished" podID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerID="4d99cd730794e799021141f0e13679f7231de8669d5cc5d788213a82a310e6c3" exitCode=0
Oct 31 13:16:13.448830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.448815    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" event={"ID":"4c7cdee4-3ef1-473a-a921-394ff5ff947f","Type":"ContainerDied","Data":"4d99cd730794e799021141f0e13679f7231de8669d5cc5d788213a82a310e6c3"}
Oct 31 13:16:13.693813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.693736    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:16:13.751867 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.751833    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:16:13.775689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.775657    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:16:13.781706 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781679    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.781810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781729    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.781810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781761    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.781929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781813    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.781929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781853    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782045 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781934    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782045 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.781965    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782045 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782010    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782057    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782096    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782152    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782224    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782300 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782282    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782325    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782364    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782403    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782442    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\") pod \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\" (UID: \"3d796daa-8bc1-481c-87e1-9ef86af9dbfd\") "
Oct 31 13:16:13.782496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782454    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:13.782496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782481    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.782709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782545    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\") pod \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\" (UID: \"4c7cdee4-3ef1-473a-a921-394ff5ff947f\") "
Oct 31 13:16:13.782952 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.782745    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.783395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.783075    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:13.783395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.783127    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.783844    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784049    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784071    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784088    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784105    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784122    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.784143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784136    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.785014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784364    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.785014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784440    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.785014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784500    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.785014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.784571    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.788082 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.787073    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "kube-api-access-8wp8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.788540 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.788457    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:13.791272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.791240    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.791401 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.791340    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.791806 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.791774    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.792038 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.791374    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "kube-api-access-ksxwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.793592 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.792848    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token" pod "3d796daa-8bc1-481c-87e1-9ef86af9dbfd" (UID: "3d796daa-8bc1-481c-87e1-9ef86af9dbfd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.793592 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.793522    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo" pod "4c7cdee4-3ef1-473a-a921-394ff5ff947f" (UID: "4c7cdee4-3ef1-473a-a921-394ff5ff947f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:13.884996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.884955    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885046    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885085    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885112    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885156    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885204 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885176    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885245    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885282    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885305    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\") pod \"a621e490-a4d4-4b69-9870-aff6bdad4b56\" (UID: \"a621e490-a4d4-4b69-9870-aff6bdad4b56\") "
Oct 31 13:16:13.885482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885309    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.885482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885411    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.885758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885583    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.885821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885705    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:13.885821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.885766    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.886262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886215    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wp8b\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-kube-api-access-8wp8b\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886241    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886257    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886272    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886290    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886304    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886321    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886335    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886349    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886363    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886377    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c7cdee4-3ef1-473a-a921-394ff5ff947f-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886392    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886407    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.886433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886423    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.887068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886438    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a621e490-a4d4-4b69-9870-aff6bdad4b56-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.887068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886456    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.887068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.886470    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksxwk\" (UniqueName: \"kubernetes.io/projected/3d796daa-8bc1-481c-87e1-9ef86af9dbfd-kube-api-access-ksxwk\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.887784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.887759    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:13.887873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.887787    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "kube-api-access-h4qd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.887937 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.887871    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:13.887998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.887981    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy" pod "a621e490-a4d4-4b69-9870-aff6bdad4b56" (UID: "a621e490-a4d4-4b69-9870-aff6bdad4b56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:13.987888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.987857    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.987888 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.987891    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4qd9\" (UniqueName: \"kubernetes.io/projected/a621e490-a4d4-4b69-9870-aff6bdad4b56-kube-api-access-h4qd9\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.988051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.987902    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:13.988051 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:13.987911    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a621e490-a4d4-4b69-9870-aff6bdad4b56-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:14.419834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.419742    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:14.461259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.461219    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb" event={"ID":"4c7cdee4-3ef1-473a-a921-394ff5ff947f","Type":"ContainerDied","Data":"2e421dbdd37559294cb7c6aa705c97c2a43cc7a40985dcbf084b7f36c26c2c7e"}
Oct 31 13:16:14.461777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.461303    4958 scope.go:122] "RemoveContainer" containerID="4d99cd730794e799021141f0e13679f7231de8669d5cc5d788213a82a310e6c3"
Oct 31 13:16:14.461777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.461226    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"
Oct 31 13:16:14.463323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.463199    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"
Oct 31 13:16:14.463323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.463247    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6" event={"ID":"a621e490-a4d4-4b69-9870-aff6bdad4b56","Type":"ContainerDied","Data":"f45f7664df36eeb157d6f19c888c32f91fa56084a47de85c8ef0c157c2dbcbe1"}
Oct 31 13:16:14.465002 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.464977    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk" event={"ID":"3d796daa-8bc1-481c-87e1-9ef86af9dbfd","Type":"ContainerDied","Data":"cf94855deb67ce3660ff7a321e4e5e9ed27a38182ca66b96ce75318be5f523c6"}
Oct 31 13:16:14.465103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.464986    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"
Oct 31 13:16:14.475833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.475812    4958 scope.go:122] "RemoveContainer" containerID="535f20bb2afb44fd5f08dc26c29f4cf633d76e322ca6828441285c5d2b39290d"
Oct 31 13:16:14.485927 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.485905    4958 scope.go:122] "RemoveContainer" containerID="d4fefed1c5a3d83280f540d109fca2943dfc38c12dd8308dc76ddd51150cf82e"
Oct 31 13:16:14.494830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.494804    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:16:14.499507 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.499485    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-6lsvb"]
Oct 31 13:16:14.517955 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.517899    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:16:14.524837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.524802    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-b2dr6"]
Oct 31 13:16:14.533031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.533001    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:16:14.541615 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.539887    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-79c6ff-openshift-default-6bc6b55775-5wbrk"]
Oct 31 13:16:14.640484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.639959    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:14.640484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.640017    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:14.790894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.790854    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:16:14.791398 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.791159    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" podUID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" containerName="maas-api" containerID="cri-o://99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0" gracePeriod=30
Oct 31 13:16:14.852770 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.852736    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:16:14.879414 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.879385    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:16:14.894745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.894711    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:14.899388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899361    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.899543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899482    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.899601 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899543    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.899601 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899590    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.899924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899902    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.899982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899950    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:14.900041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.899976    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.900041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900012    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.900136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900068    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.900136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900108    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\") pod \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\" (UID: \"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796\") "
Oct 31 13:16:14.900330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900308    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:14.900704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900683    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:14.900778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.900711    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:14.901428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.901405    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:14.901758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.901735    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:14.901825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.901801    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:14.903174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.903150    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:14.903525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.903501    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "kube-api-access-r2jdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:14.907028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.906989    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:14.908729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:14.908695    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token" pod "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" (UID: "f2fb32db-e0b7-479a-a42f-6b4c9e1c0796"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.001692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001656    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.001846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001743    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.001846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001793    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.001846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001832    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001882    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001913    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.001994    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002105    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002185    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\") pod \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\" (UID: \"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335\") "
Oct 31 13:16:15.002277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002206    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.002277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002223    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.002407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002374    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.002475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002405    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:15.002729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002707    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002729    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002743    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002756    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002769    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002781    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002793    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002806    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002819    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002832    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jdg\" (UniqueName: \"kubernetes.io/projected/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-kube-api-access-r2jdg\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002845    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.002964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.002951    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.004042 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.004013    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "kube-api-access-vsn5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.004457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.004422    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.004555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.004509    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.004555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.004508    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo" pod "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" (UID: "bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:15.080390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.077308    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:15.080390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.077384    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:15.101515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.101289    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:15.104873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.104757    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.104873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.104789    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.104873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.104806    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.104873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.104821    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.104873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.104836    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsn5x\" (UniqueName: \"kubernetes.io/projected/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335-kube-api-access-vsn5x\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.176629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.175817    4958 patch_prober.go:29] interesting pod/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:15.176629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.175916    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:15.312026 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.311996    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:16:15.326501 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.326467    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:15.360322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.360274    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:16:15.409016 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.408984    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\" (UniqueName: \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\") pod \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") "
Oct 31 13:16:15.409198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409025    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409052    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409107    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409162    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\") pod \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") "
Oct 31 13:16:15.409444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409233    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409281    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409444 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409314    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409462    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.409628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409582    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409754    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\") pod \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") "
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409798    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\") pod \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\" (UID: \"8d8db944-8073-4ac0-9ef9-2b92bf766a3e\") "
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409834    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409801    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409849    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.409876    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\") pod \"57121605-f2c9-4d15-b7f8-ce8d688f712c\" (UID: \"57121605-f2c9-4d15-b7f8-ce8d688f712c\") "
Oct 31 13:16:15.410260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.410070    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.411237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.410974    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:15.412048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.411697    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.412048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.411731    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.412048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.411746    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.412048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.411760    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57121605-f2c9-4d15-b7f8-ce8d688f712c-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.412048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.411776    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.412393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412372    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca" pod "8d8db944-8073-4ac0-9ef9-2b92bf766a3e" (UID: "8d8db944-8073-4ac0-9ef9-2b92bf766a3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:15.412588 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412562    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:15.412911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412891    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.412911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412903    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls" pod "8d8db944-8073-4ac0-9ef9-2b92bf766a3e" (UID: "8d8db944-8073-4ac0-9ef9-2b92bf766a3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:15.412911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412893    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:15.413061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.412921    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc" pod "8d8db944-8073-4ac0-9ef9-2b92bf766a3e" (UID: "8d8db944-8073-4ac0-9ef9-2b92bf766a3e"). InnerVolumeSpecName "kube-api-access-l2fhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.414058 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.414035    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88" pod "57121605-f2c9-4d15-b7f8-ce8d688f712c" (UID: "57121605-f2c9-4d15-b7f8-ce8d688f712c"). InnerVolumeSpecName "kube-api-access-x9x88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:15.414566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.414540    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs" pod "8d8db944-8073-4ac0-9ef9-2b92bf766a3e" (UID: "8d8db944-8073-4ac0-9ef9-2b92bf766a3e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:15.479016 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.478978    4958 generic.go:356] "Generic (PLEG): container finished" podID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerID="a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe" exitCode=0
Oct 31 13:16:15.479536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.479053    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"
Oct 31 13:16:15.479536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.479075    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" event={"ID":"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335","Type":"ContainerDied","Data":"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"}
Oct 31 13:16:15.479536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.479144    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p" event={"ID":"bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335","Type":"ContainerDied","Data":"1d5ddce51f1c7b45a9455175fb1f298440ec4542b54391eb4c732b641357ad89"}
Oct 31 13:16:15.479536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.479175    4958 scope.go:122] "RemoveContainer" containerID="a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"
Oct 31 13:16:15.483163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.483135    4958 generic.go:356] "Generic (PLEG): container finished" podID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerID="f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55" exitCode=0
Oct 31 13:16:15.483322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.483201    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"
Oct 31 13:16:15.483322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.483214    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" event={"ID":"57121605-f2c9-4d15-b7f8-ce8d688f712c","Type":"ContainerDied","Data":"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"}
Oct 31 13:16:15.484064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.484021    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5" event={"ID":"57121605-f2c9-4d15-b7f8-ce8d688f712c","Type":"ContainerDied","Data":"3b29ba583279862a9e02d202b530ef4ae0bc97db5f3878b223dd4ed4b8fa15df"}
Oct 31 13:16:15.492652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.490919    4958 generic.go:356] "Generic (PLEG): container finished" podID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerID="177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2" exitCode=0
Oct 31 13:16:15.492652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.490975    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"
Oct 31 13:16:15.492652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.491061    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" event={"ID":"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796","Type":"ContainerDied","Data":"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"}
Oct 31 13:16:15.492652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.491121    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k" event={"ID":"f2fb32db-e0b7-479a-a42f-6b4c9e1c0796","Type":"ContainerDied","Data":"1a1eda27bce2201369be1b8ebb7f19f25c9179cbab2b5f8c358fe8b0509600ce"}
Oct 31 13:16:15.493335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.492889    4958 generic.go:356] "Generic (PLEG): container finished" podID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" containerID="99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0" exitCode=0
Oct 31 13:16:15.493335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.492962    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" event={"ID":"8d8db944-8073-4ac0-9ef9-2b92bf766a3e","Type":"ContainerDied","Data":"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"}
Oct 31 13:16:15.493335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.492998    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg" event={"ID":"8d8db944-8073-4ac0-9ef9-2b92bf766a3e","Type":"ContainerDied","Data":"bcdb30c8f9e0d346836e082c959b15ec02c6629227613e2d9b52419613ff6d74"}
Oct 31 13:16:15.493335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.493075    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"
Oct 31 13:16:15.498753 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.498732    4958 scope.go:122] "RemoveContainer" containerID="a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"
Oct 31 13:16:15.499086 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:15.499058    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe\": container with ID starting with a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe not found: ID does not exist" containerID="a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"
Oct 31 13:16:15.499156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.499097    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe"} err="failed to get container status \"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe\": rpc error: code = NotFound desc = could not find container \"a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe\": container with ID starting with a11efabfa2cf54fdf1d804dda895c49bfb27c65f7d955bc151a8e9351038e1fe not found: ID does not exist"
Oct 31 13:16:15.499156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.499121    4958 scope.go:122] "RemoveContainer" containerID="f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513434    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513463    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513478    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513493    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2fhc\" (UniqueName: \"kubernetes.io/projected/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-kube-api-access-l2fhc\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513507    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513519    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513534    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d8db944-8073-4ac0-9ef9-2b92bf766a3e-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.513546    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9x88\" (UniqueName: \"kubernetes.io/projected/57121605-f2c9-4d15-b7f8-ce8d688f712c-kube-api-access-x9x88\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.516034    4958 scope.go:122] "RemoveContainer" containerID="f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:15.516421    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55\": container with ID starting with f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55 not found: ID does not exist" containerID="f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.516458    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55"} err="failed to get container status \"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55\": rpc error: code = NotFound desc = could not find container \"f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55\": container with ID starting with f03fef4dd88cccf8dc5b05acac297ec1a9160f8fc470a9b63fde0be132e25a55 not found: ID does not exist"
Oct 31 13:16:15.516690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.516483    4958 scope.go:122] "RemoveContainer" containerID="177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"
Oct 31 13:16:15.526250 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.526168    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:16:15.532867 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.532842    4958 scope.go:122] "RemoveContainer" containerID="177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"
Oct 31 13:16:15.535704 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:15.535669    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2\": container with ID starting with 177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2 not found: ID does not exist" containerID="177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"
Oct 31 13:16:15.535837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.535712    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2"} err="failed to get container status \"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2\": rpc error: code = NotFound desc = could not find container \"177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2\": container with ID starting with 177ed8687f54bccc02a0f302b23205f66675b19d83ffbce80c235dee0bb7b9d2 not found: ID does not exist"
Oct 31 13:16:15.535837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.535735    4958 scope.go:122] "RemoveContainer" containerID="99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"
Oct 31 13:16:15.539257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.539229    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wt5g5"]
Oct 31 13:16:15.550295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.550267    4958 scope.go:122] "RemoveContainer" containerID="99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"
Oct 31 13:16:15.550408 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.550365    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:16:15.550644 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:15.550621    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0\": container with ID starting with 99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0 not found: ID does not exist" containerID="99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"
Oct 31 13:16:15.550721 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.550655    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0"} err="failed to get container status \"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0\": rpc error: code = NotFound desc = could not find container \"99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0\": container with ID starting with 99e47a7a95c3c8cf3dfd8ed7a8fe8a98760499d8425f66481a34c0abc50c5cf0 not found: ID does not exist"
Oct 31 13:16:15.553991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.553971    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-wm92p"]
Oct 31 13:16:15.569198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.569169    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:16:15.572437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.572414    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7bf66c-5b4c869ff-2v9fg"]
Oct 31 13:16:15.587997 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.587961    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:16:15.596524 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.596486    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-2a262a-openshift-default-5d9b94b5cc-b8q2k"]
Oct 31 13:16:15.628355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.628315    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:15.628632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.628589    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:15.690908 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:15.690836    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:16.190791 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.190765    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:16:16.220442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.220398    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\") pod \"2d23592c-3c08-4562-bde6-895b1a25bedf\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") "
Oct 31 13:16:16.221116 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.221061    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\" (UniqueName: \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\") pod \"2d23592c-3c08-4562-bde6-895b1a25bedf\" (UID: \"2d23592c-3c08-4562-bde6-895b1a25bedf\") "
Oct 31 13:16:16.221747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.221278    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume" pod "2d23592c-3c08-4562-bde6-895b1a25bedf" (UID: "2d23592c-3c08-4562-bde6-895b1a25bedf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:16.221747 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.221599    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d23592c-3c08-4562-bde6-895b1a25bedf-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:16.224748 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.224707    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v" pod "2d23592c-3c08-4562-bde6-895b1a25bedf" (UID: "2d23592c-3c08-4562-bde6-895b1a25bedf"). InnerVolumeSpecName "kube-api-access-j9t6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:16.322624 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.322576    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9t6v\" (UniqueName: \"kubernetes.io/projected/2d23592c-3c08-4562-bde6-895b1a25bedf-kube-api-access-j9t6v\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:16.383905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.383870    4958 patch_prober.go:29] interesting pod/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:16.384066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.383934    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:16.493110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.493027    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" path="/var/lib/kubelet/pods/3d796daa-8bc1-481c-87e1-9ef86af9dbfd/volumes"
Oct 31 13:16:16.493569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.493554    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" path="/var/lib/kubelet/pods/4c7cdee4-3ef1-473a-a921-394ff5ff947f/volumes"
Oct 31 13:16:16.494074 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.494055    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" path="/var/lib/kubelet/pods/57121605-f2c9-4d15-b7f8-ce8d688f712c/volumes"
Oct 31 13:16:16.494761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.494742    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" path="/var/lib/kubelet/pods/8d8db944-8073-4ac0-9ef9-2b92bf766a3e/volumes"
Oct 31 13:16:16.495224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.495210    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" path="/var/lib/kubelet/pods/a621e490-a4d4-4b69-9870-aff6bdad4b56/volumes"
Oct 31 13:16:16.495670 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.495653    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" path="/var/lib/kubelet/pods/bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335/volumes"
Oct 31 13:16:16.496446 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.496428    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" path="/var/lib/kubelet/pods/f2fb32db-e0b7-479a-a42f-6b4c9e1c0796/volumes"
Oct 31 13:16:16.529370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.529340    4958 generic.go:356] "Generic (PLEG): container finished" podID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerID="fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb" exitCode=0
Oct 31 13:16:16.529496 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.529413    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" event={"ID":"2d23592c-3c08-4562-bde6-895b1a25bedf","Type":"ContainerDied","Data":"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"}
Oct 31 13:16:16.529667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.529498    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979" event={"ID":"2d23592c-3c08-4562-bde6-895b1a25bedf","Type":"ContainerDied","Data":"e11052781253b87f3e8d4ff8d0db8bc55416d69c7ca7babe99b28d387cf7dce2"}
Oct 31 13:16:16.529667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.529421    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"
Oct 31 13:16:16.529667 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.529571    4958 scope.go:122] "RemoveContainer" containerID="fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"
Oct 31 13:16:16.565210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.565185    4958 scope.go:122] "RemoveContainer" containerID="fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"
Oct 31 13:16:16.565651 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:16.565623    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb\": container with ID starting with fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb not found: ID does not exist" containerID="fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"
Oct 31 13:16:16.565729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.565661    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb"} err="failed to get container status \"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb\": rpc error: code = NotFound desc = could not find container \"fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb\": container with ID starting with fedca0b6e8da869f4161ff7a09274d4380d4c9f16a354d9a6c834b263f733aeb not found: ID does not exist"
Oct 31 13:16:16.577878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.577842    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:16:16.583850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.583817    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-426787-74f5cf499-l2979"]
Oct 31 13:16:16.702579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.702548    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:16:16.829932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.829809    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\") pod \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") "
Oct 31 13:16:16.829932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.829916    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\" (UniqueName: \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\") pod \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\" (UID: \"fb9fd0ca-bb43-49e0-bbf2-3006262effaf\") "
Oct 31 13:16:16.830232 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.830203    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume" pod "fb9fd0ca-bb43-49e0-bbf2-3006262effaf" (UID: "fb9fd0ca-bb43-49e0-bbf2-3006262effaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:16.830486 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.830464    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:16.832510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.832467    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk" pod "fb9fd0ca-bb43-49e0-bbf2-3006262effaf" (UID: "fb9fd0ca-bb43-49e0-bbf2-3006262effaf"). InnerVolumeSpecName "kube-api-access-g7dlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:16.932235 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:16.932194    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7dlk\" (UniqueName: \"kubernetes.io/projected/fb9fd0ca-bb43-49e0-bbf2-3006262effaf-kube-api-access-g7dlk\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.529439 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.529156    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:16:17.572341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.571561    4958 generic.go:356] "Generic (PLEG): container finished" podID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerID="f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316" exitCode=0
Oct 31 13:16:17.572341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.571686    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" event={"ID":"64c749dd-f9f6-438c-b8ef-1d628ff1bc32","Type":"ContainerDied","Data":"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"}
Oct 31 13:16:17.572341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.571744    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w" event={"ID":"64c749dd-f9f6-438c-b8ef-1d628ff1bc32","Type":"ContainerDied","Data":"ff3af59735ff3b48a79bfeef5263dd1eb989f17243fb5e03da37f0ffdc78a978"}
Oct 31 13:16:17.572341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.571778    4958 scope.go:122] "RemoveContainer" containerID="f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"
Oct 31 13:16:17.572341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.571914    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"
Oct 31 13:16:17.584755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.584165    4958 generic.go:356] "Generic (PLEG): container finished" podID="c0154ebc-3756-4828-8d26-91a23b33455d" containerID="8e8d493a69235c3bc41fcf505c9723e3f74672bd81b3e63f025278916cdd50b1" exitCode=0
Oct 31 13:16:17.584755 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.584261    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" event={"ID":"c0154ebc-3756-4828-8d26-91a23b33455d","Type":"ContainerDied","Data":"8e8d493a69235c3bc41fcf505c9723e3f74672bd81b3e63f025278916cdd50b1"}
Oct 31 13:16:17.588512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.587923    4958 generic.go:356] "Generic (PLEG): container finished" podID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerID="341f1a3a04ca18a69378cb90cda415824e6c0e6bed9b6cc2e747cef54b801725" exitCode=0
Oct 31 13:16:17.588512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.588062    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" event={"ID":"c5d5dac2-f0e0-4948-b200-b72440b16930","Type":"ContainerDied","Data":"341f1a3a04ca18a69378cb90cda415824e6c0e6bed9b6cc2e747cef54b801725"}
Oct 31 13:16:17.591650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.591169    4958 generic.go:356] "Generic (PLEG): container finished" podID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerID="ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c" exitCode=0
Oct 31 13:16:17.591650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.591329    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" event={"ID":"fb9fd0ca-bb43-49e0-bbf2-3006262effaf","Type":"ContainerDied","Data":"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"}
Oct 31 13:16:17.591650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.591379    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288" event={"ID":"fb9fd0ca-bb43-49e0-bbf2-3006262effaf","Type":"ContainerDied","Data":"4002000ecacbc7d9dfbd013aad5cfe8c82b353618eb08187c553cec1815138e3"}
Oct 31 13:16:17.591650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.591465    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"
Oct 31 13:16:17.674597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674489    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.674597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674646    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.674890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674706    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.674890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674745    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.674890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674830    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.675083 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674935    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.675083 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.674997    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.675083 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.675077    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.675386 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.675356    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\") pod \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\" (UID: \"64c749dd-f9f6-438c-b8ef-1d628ff1bc32\") "
Oct 31 13:16:17.676472 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.676439    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.676822 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.676796    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.677220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.677199    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.680195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.680157    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:17.683022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.682740    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:17.688262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.687973    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "kube-api-access-mzg9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:17.691207 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.691007    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.691566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.691374    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.693882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.691882    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert" pod "64c749dd-f9f6-438c-b8ef-1d628ff1bc32" (UID: "64c749dd-f9f6-438c-b8ef-1d628ff1bc32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:17.706552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.706484    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:16:17.765037 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.764998    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-426787-84bfc898c9-9j288"]
Oct 31 13:16:17.765389 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.765368    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785689    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785732    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785774    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785790    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzg9l\" (UniqueName: \"kubernetes.io/projected/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-kube-api-access-mzg9l\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785805    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785819    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785835    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785850    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.785892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.785864    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64c749dd-f9f6-438c-b8ef-1d628ff1bc32-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:17.817294 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.817253    4958 scope.go:122] "RemoveContainer" containerID="f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"
Oct 31 13:16:17.826861 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:17.826817    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316\": container with ID starting with f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316 not found: ID does not exist" containerID="f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"
Oct 31 13:16:17.835739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.835689    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316"} err="failed to get container status \"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316\": rpc error: code = NotFound desc = could not find container \"f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316\": container with ID starting with f7d8fa859491586c752a5ff85207c5aafe655cf1a03e227b6c666bc811023316 not found: ID does not exist"
Oct 31 13:16:17.835958 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.835935    4958 scope.go:122] "RemoveContainer" containerID="ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.907978    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908088    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908126    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908183    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908227    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908266    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908372    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908412    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.908473    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\") pod \"c0154ebc-3756-4828-8d26-91a23b33455d\" (UID: \"c0154ebc-3756-4828-8d26-91a23b33455d\") "
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.911358    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.912914    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.913157    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.922695 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.914076    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:17.927382 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.927286    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:17.962643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:17.962589    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:16:18.005810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.003981    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:18.005810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.004742    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "kube-api-access-jgfjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.015979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.015942    4958 scope.go:122] "RemoveContainer" containerID="ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"
Oct 31 13:16:18.016659 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.016418    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.016999 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:18.016922    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c\": container with ID starting with ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c not found: ID does not exist" containerID="ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"
Oct 31 13:16:18.016999 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.016967    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c"} err="failed to get container status \"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c\": rpc error: code = NotFound desc = could not find container \"ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c\": container with ID starting with ea4a74c83d8ecc0f820155258e238e4a2d7ff9250526b0e086b6780a2a0fb54c not found: ID does not exist"
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.016990    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017020    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017038    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0154ebc-3756-4828-8d26-91a23b33455d-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017053    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017070    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017084    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017100    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgfjw\" (UniqueName: \"kubernetes.io/projected/c0154ebc-3756-4828-8d26-91a23b33455d-kube-api-access-jgfjw\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.017165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.017115    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0154ebc-3756-4828-8d26-91a23b33455d-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.114925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.114511    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:16:18.114925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.114817    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy" pod "c0154ebc-3756-4828-8d26-91a23b33455d" (UID: "c0154ebc-3756-4828-8d26-91a23b33455d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.140544    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149635    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149743    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149790    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149824    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149903    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.149949    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.150009    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.150107    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\") pod \"c5d5dac2-f0e0-4948-b200-b72440b16930\" (UID: \"c5d5dac2-f0e0-4948-b200-b72440b16930\") "
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.150567    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0154ebc-3756-4828-8d26-91a23b33455d-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.151943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.151043    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.156288 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.155957    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.156507 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.156482    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.156702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.156666    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.157230 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.157194    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:18.235869 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.235804    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-wq48w"]
Oct 31 13:16:18.255035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.254906    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.255035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.254955    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d5dac2-f0e0-4948-b200-b72440b16930-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.255035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.254971    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.255035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.254986    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.255035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.255001    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.272629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.270619    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:18.272629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.271140    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.308896 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.308817    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.308896 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.308834    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw" pod "c5d5dac2-f0e0-4948-b200-b72440b16930" (UID: "c5d5dac2-f0e0-4948-b200-b72440b16930"). InnerVolumeSpecName "kube-api-access-qsbjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.373769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.356229    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.373769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.356268    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsbjw\" (UniqueName: \"kubernetes.io/projected/c5d5dac2-f0e0-4948-b200-b72440b16930-kube-api-access-qsbjw\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.373769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.356286    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.373769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.356301    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d5dac2-f0e0-4948-b200-b72440b16930-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.523629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.523475    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" path="/var/lib/kubelet/pods/2d23592c-3c08-4562-bde6-895b1a25bedf/volumes"
Oct 31 13:16:18.529628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.524478    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" path="/var/lib/kubelet/pods/64c749dd-f9f6-438c-b8ef-1d628ff1bc32/volumes"
Oct 31 13:16:18.533458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.530693    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" path="/var/lib/kubelet/pods/fb9fd0ca-bb43-49e0-bbf2-3006262effaf/volumes"
Oct 31 13:16:18.605578 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.605546    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq" event={"ID":"c0154ebc-3756-4828-8d26-91a23b33455d","Type":"ContainerDied","Data":"3521743a6e48499188a189b13b379dbb910ab69e5e56a12032bcacbc57da1dc0"}
Oct 31 13:16:18.605775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.605710    4958 scope.go:122] "RemoveContainer" containerID="8e8d493a69235c3bc41fcf505c9723e3f74672bd81b3e63f025278916cdd50b1"
Oct 31 13:16:18.605895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.605879    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"
Oct 31 13:16:18.613106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.613076    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k" event={"ID":"c5d5dac2-f0e0-4948-b200-b72440b16930","Type":"ContainerDied","Data":"bde9a40f8300d7c3526b328b54b5895de0e25a204ed9daf283da5626a81cd9b8"}
Oct 31 13:16:18.613223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.613207    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"
Oct 31 13:16:18.616625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.616307    4958 generic.go:356] "Generic (PLEG): container finished" podID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerID="adb2ac61fdf79451e47b30985f6689b77308f0ef7ef13c20313e214a0aac66ef" exitCode=0
Oct 31 13:16:18.616625 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.616421    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" event={"ID":"72b0dc49-dc42-41a6-b363-15cedf50afaa","Type":"ContainerDied","Data":"adb2ac61fdf79451e47b30985f6689b77308f0ef7ef13c20313e214a0aac66ef"}
Oct 31 13:16:18.632768 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.632735    4958 generic.go:356] "Generic (PLEG): container finished" podID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerID="5ad7dea222a92991ed4e1e6a668c300155e49524a58f950b511c32221ef1b4b8" exitCode=0
Oct 31 13:16:18.633000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.632859    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" event={"ID":"b81b9a5a-83a9-4477-bee5-a8b0c091f696","Type":"ContainerDied","Data":"5ad7dea222a92991ed4e1e6a668c300155e49524a58f950b511c32221ef1b4b8"}
Oct 31 13:16:18.637032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.636859    4958 generic.go:356] "Generic (PLEG): container finished" podID="228b0819-9f58-4ea0-8020-361205000f2a" containerID="326e7b3903c6f9b74bfb0b5a6002f4663c97b4f4b54af6c488bf78d1d7dd631c" exitCode=0
Oct 31 13:16:18.637032 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.636953    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" event={"ID":"228b0819-9f58-4ea0-8020-361205000f2a","Type":"ContainerDied","Data":"326e7b3903c6f9b74bfb0b5a6002f4663c97b4f4b54af6c488bf78d1d7dd631c"}
Oct 31 13:16:18.640205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.640100    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:16:18.650813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.650773    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-5kvzq"]
Oct 31 13:16:18.655867 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.655810    4958 scope.go:122] "RemoveContainer" containerID="341f1a3a04ca18a69378cb90cda415824e6c0e6bed9b6cc2e747cef54b801725"
Oct 31 13:16:18.661148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.661117    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:16:18.699341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.699307    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:16:18.702191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.702155    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-004f64-openshift-default-95df6bdc-m5x4k"]
Oct 31 13:16:18.705586 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.705538    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:16:18.743270 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.743242    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:16:18.768063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.767831    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.768063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768053    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768441 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768417    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.768503 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768485    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768524    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.768570 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768553    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768624 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768597    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.768684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768646    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.768772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768687    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.768772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768716    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768755    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.768935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768810    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768843    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.768935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768886    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768940    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.769095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.768982    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769018    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769067    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769104    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769160    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769413    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.769473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769450    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:18.769646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769507    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.769646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769558    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\") pod \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\" (UID: \"b81b9a5a-83a9-4477-bee5-a8b0c091f696\") "
Oct 31 13:16:18.769646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769630    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.769802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769677    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.769802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769730    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.769802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769781    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\") pod \"72b0dc49-dc42-41a6-b363-15cedf50afaa\" (UID: \"72b0dc49-dc42-41a6-b363-15cedf50afaa\") "
Oct 31 13:16:18.769942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.769819    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\") pod \"228b0819-9f58-4ea0-8020-361205000f2a\" (UID: \"228b0819-9f58-4ea0-8020-361205000f2a\") "
Oct 31 13:16:18.771643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.770265    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.771643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.770208    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.771643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.770759    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.771643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.771003    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:18.771643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.771560    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.772324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.772302    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.773132 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.773100    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.773976 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.773804    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.774306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.774143    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.774562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.774411    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.775018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.774713    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.775217 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.775191    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.776058 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776042    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b0dc49-dc42-41a6-b363-15cedf50afaa-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776146 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776136    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776191    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776249 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776241    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/228b0819-9f58-4ea0-8020-361205000f2a-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776296 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776289    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776412 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776403    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776458    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776518 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776511    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776559    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776698 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776680    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776707    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776721    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776736    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.776775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.776750    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.777081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777059    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.777954 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777174    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:18.778104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777256    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "kube-api-access-j6k4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.778222 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777304    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "kube-api-access-nm77b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.778331 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777529    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:18.778437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777798    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.778717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.778655    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.778717 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.777900    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.778863 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.778764    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:18.779882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.779856    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "kube-api-access-s4pl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:18.780077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.780052    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy" pod "72b0dc49-dc42-41a6-b363-15cedf50afaa" (UID: "72b0dc49-dc42-41a6-b363-15cedf50afaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.780165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.780057    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo" pod "228b0819-9f58-4ea0-8020-361205000f2a" (UID: "228b0819-9f58-4ea0-8020-361205000f2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:18.780349 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.780329    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy" pod "b81b9a5a-83a9-4477-bee5-a8b0c091f696" (UID: "b81b9a5a-83a9-4477-bee5-a8b0c091f696"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:18.877902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877866    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.877902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877896    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.877902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877906    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877917    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877928    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b81b9a5a-83a9-4477-bee5-a8b0c091f696-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877940    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4pl4\" (UniqueName: \"kubernetes.io/projected/72b0dc49-dc42-41a6-b363-15cedf50afaa-kube-api-access-s4pl4\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877950    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/228b0819-9f58-4ea0-8020-361205000f2a-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877959    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877967    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b0dc49-dc42-41a6-b363-15cedf50afaa-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877975    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm77b\" (UniqueName: \"kubernetes.io/projected/228b0819-9f58-4ea0-8020-361205000f2a-kube-api-access-nm77b\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877983    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6k4g\" (UniqueName: \"kubernetes.io/projected/b81b9a5a-83a9-4477-bee5-a8b0c091f696-kube-api-access-j6k4g\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.877992    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/228b0819-9f58-4ea0-8020-361205000f2a-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:18.878218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:18.878001    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b81b9a5a-83a9-4477-bee5-a8b0c091f696-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:19.647979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.647936    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw" event={"ID":"b81b9a5a-83a9-4477-bee5-a8b0c091f696","Type":"ContainerDied","Data":"ee0e23e1181a4e812b924d17d3ae876ed65ac925e44f7e3d99a63f9b17ac8af2"}
Oct 31 13:16:19.648475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.647994    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"
Oct 31 13:16:19.648475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.648015    4958 scope.go:122] "RemoveContainer" containerID="5ad7dea222a92991ed4e1e6a668c300155e49524a58f950b511c32221ef1b4b8"
Oct 31 13:16:19.650530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.650504    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"
Oct 31 13:16:19.650530 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.650511    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs" event={"ID":"228b0819-9f58-4ea0-8020-361205000f2a","Type":"ContainerDied","Data":"2322783c3cac2bdba3edba296093b9c7dc1b2fa6c95f5b1857cb72498a2b5c19"}
Oct 31 13:16:19.657972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.657937    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p" event={"ID":"72b0dc49-dc42-41a6-b363-15cedf50afaa","Type":"ContainerDied","Data":"033fbc1eb8dcf1633200719069d5826b932ce92574ff4e908f4093055e3009a2"}
Oct 31 13:16:19.658106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.658066    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"
Oct 31 13:16:19.668133 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:19.665628    4958 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81b9a5a_83a9_4477_bee5_a8b0c091f696.slice/crio-ee0e23e1181a4e812b924d17d3ae876ed65ac925e44f7e3d99a63f9b17ac8af2\": RecentStats: unable to find data in memory cache]"
Oct 31 13:16:19.668133 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.666763    4958 scope.go:122] "RemoveContainer" containerID="326e7b3903c6f9b74bfb0b5a6002f4663c97b4f4b54af6c488bf78d1d7dd631c"
Oct 31 13:16:19.683319 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.683286    4958 scope.go:122] "RemoveContainer" containerID="adb2ac61fdf79451e47b30985f6689b77308f0ef7ef13c20313e214a0aac66ef"
Oct 31 13:16:19.690000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.689971    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:16:19.695183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.693817    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-s2gbw"]
Oct 31 13:16:19.711104 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.711067    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:16:19.717195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.717162    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-hpsqs"]
Oct 31 13:16:19.733219 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.733178    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:16:19.738725 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:19.738675    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-426787-openshift-default-5ffc64c5c7-vsk4p"]
Oct 31 13:16:20.493057 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:20.493026    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="228b0819-9f58-4ea0-8020-361205000f2a" path="/var/lib/kubelet/pods/228b0819-9f58-4ea0-8020-361205000f2a/volumes"
Oct 31 13:16:20.493544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:20.493528    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" path="/var/lib/kubelet/pods/72b0dc49-dc42-41a6-b363-15cedf50afaa/volumes"
Oct 31 13:16:20.493996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:20.493982    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" path="/var/lib/kubelet/pods/b81b9a5a-83a9-4477-bee5-a8b0c091f696/volumes"
Oct 31 13:16:20.494734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:20.494717    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" path="/var/lib/kubelet/pods/c0154ebc-3756-4828-8d26-91a23b33455d/volumes"
Oct 31 13:16:20.495177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:20.495160    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" path="/var/lib/kubelet/pods/c5d5dac2-f0e0-4948-b200-b72440b16930/volumes"
Oct 31 13:16:21.083819 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.083792    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:16:21.102673 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.102601    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\") pod \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") "
Oct 31 13:16:21.102850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.102705    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\" (UniqueName: \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\") pod \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\" (UID: \"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a\") "
Oct 31 13:16:21.103110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.103085    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume" pod "2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" (UID: "2df344e9-34f5-4e4c-a5ed-ffd23ac7820a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:21.105860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.105823    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp" pod "2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" (UID: "2df344e9-34f5-4e4c-a5ed-ffd23ac7820a"). InnerVolumeSpecName "kube-api-access-lmslp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:21.131986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.131948    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:16:21.204018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.203973    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\" (UniqueName: \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\") pod \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") "
Oct 31 13:16:21.204210 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.204024    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\") pod \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\" (UID: \"9164fd1f-c692-449b-8fa3-51bf89b7d97a\") "
Oct 31 13:16:21.204328 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.204311    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:21.204390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.204332    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmslp\" (UniqueName: \"kubernetes.io/projected/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a-kube-api-access-lmslp\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:21.204440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.204403    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume" pod "9164fd1f-c692-449b-8fa3-51bf89b7d97a" (UID: "9164fd1f-c692-449b-8fa3-51bf89b7d97a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:21.206366 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.206339    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r" pod "9164fd1f-c692-449b-8fa3-51bf89b7d97a" (UID: "9164fd1f-c692-449b-8fa3-51bf89b7d97a"). InnerVolumeSpecName "kube-api-access-8kf7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:21.305431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.305344    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kf7r\" (UniqueName: \"kubernetes.io/projected/9164fd1f-c692-449b-8fa3-51bf89b7d97a-kube-api-access-8kf7r\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:21.305431 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.305387    4958 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9164fd1f-c692-449b-8fa3-51bf89b7d97a-plugins-config-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:21.679664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.679571    4958 generic.go:356] "Generic (PLEG): container finished" podID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerID="c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327" exitCode=0
Oct 31 13:16:21.679664 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.679640    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" event={"ID":"9164fd1f-c692-449b-8fa3-51bf89b7d97a","Type":"ContainerDied","Data":"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"}
Oct 31 13:16:21.679849 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.679661    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"
Oct 31 13:16:21.679849 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.679750    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8" event={"ID":"9164fd1f-c692-449b-8fa3-51bf89b7d97a","Type":"ContainerDied","Data":"6fb114626aef3ca61ed9a140f1592d5271241ad77b53e97ff0e500123ae28a56"}
Oct 31 13:16:21.679849 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.679772    4958 scope.go:122] "RemoveContainer" containerID="c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"
Oct 31 13:16:21.681045 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.681017    4958 generic.go:356] "Generic (PLEG): container finished" podID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerID="64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d" exitCode=0
Oct 31 13:16:21.681388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.681081    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"
Oct 31 13:16:21.681388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.681082    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" event={"ID":"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a","Type":"ContainerDied","Data":"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"}
Oct 31 13:16:21.681388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.681154    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9" event={"ID":"2df344e9-34f5-4e4c-a5ed-ffd23ac7820a","Type":"ContainerDied","Data":"d604f75c0f5e5c795dcfd29b82bf2405a96fe11c4a208d497a12bf6b50625657"}
Oct 31 13:16:21.691694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.691671    4958 scope.go:122] "RemoveContainer" containerID="c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"
Oct 31 13:16:21.692054 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:21.692022    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327\": container with ID starting with c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327 not found: ID does not exist" containerID="c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"
Oct 31 13:16:21.692212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.692057    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327"} err="failed to get container status \"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327\": rpc error: code = NotFound desc = could not find container \"c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327\": container with ID starting with c211ea8e2b5a9c7ac8c7e9198857a926debe828478c1d7020e851e2c01f6d327 not found: ID does not exist"
Oct 31 13:16:21.692212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.692079    4958 scope.go:122] "RemoveContainer" containerID="64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"
Oct 31 13:16:21.702451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.702429    4958 scope.go:122] "RemoveContainer" containerID="64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"
Oct 31 13:16:21.702775 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:21.702756    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d\": container with ID starting with 64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d not found: ID does not exist" containerID="64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"
Oct 31 13:16:21.702825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.702785    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d"} err="failed to get container status \"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d\": rpc error: code = NotFound desc = could not find container \"64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d\": container with ID starting with 64d10fc3cb118080a0d0167a633e67028667d999d76bf5f5e5cdccd9995da47d not found: ID does not exist"
Oct 31 13:16:21.711351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.711320    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:16:21.714505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.714478    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7bf66c-57654496f5-72rc8"]
Oct 31 13:16:21.728173 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.728142    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:16:21.735262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:21.735232    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-7bf66c-db5dbdb9f-cgrb9"]
Oct 31 13:16:22.116799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:22.116761    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:22.491363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:22.491328    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" path="/var/lib/kubelet/pods/2df344e9-34f5-4e4c-a5ed-ffd23ac7820a/volumes"
Oct 31 13:16:22.491777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:22.491763    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" path="/var/lib/kubelet/pods/9164fd1f-c692-449b-8fa3-51bf89b7d97a/volumes"
Oct 31 13:16:22.964548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:22.964509    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:23.104101 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:23.104068    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:23.537812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:23.537777    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:23.689942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:23.689904    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:25.833319 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:25.833280    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:26.070831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.070799    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:26.161905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.161807    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:16:26.162386 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.162348    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" containerID="cri-o://8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc" gracePeriod=30
Oct 31 13:16:26.174363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.174321    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:16:26.174592 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.174565    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" containerID="cri-o://535f2e68c865266a5718ced9792c5218758db7459cc2fa5afa58c2654142cedf" gracePeriod=30
Oct 31 13:16:26.189197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.189160    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:16:26.189438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.189402    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" containerID="cri-o://5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff" gracePeriod=30
Oct 31 13:16:26.363802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:26.363763    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:27.406885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:27.406835    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:28.862587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:28.862552    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:16:28.863121 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:28.862827    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" podUID="7c852253-471e-4b21-87aa-22aa4ff8c454" containerName="manager" containerID="cri-o://009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701" gracePeriod=30
Oct 31 13:16:29.133373 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.133336    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:16:29.206992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.206958    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\") pod \"7c852253-471e-4b21-87aa-22aa4ff8c454\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") "
Oct 31 13:16:29.207155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.207037    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\" (UniqueName: \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\") pod \"7c852253-471e-4b21-87aa-22aa4ff8c454\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") "
Oct 31 13:16:29.207155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.207111    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\") pod \"7c852253-471e-4b21-87aa-22aa4ff8c454\" (UID: \"7c852253-471e-4b21-87aa-22aa4ff8c454\") "
Oct 31 13:16:29.209295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.209267    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs" pod "7c852253-471e-4b21-87aa-22aa4ff8c454" (UID: "7c852253-471e-4b21-87aa-22aa4ff8c454"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:29.209418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.209334    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4" pod "7c852253-471e-4b21-87aa-22aa4ff8c454" (UID: "7c852253-471e-4b21-87aa-22aa4ff8c454"). InnerVolumeSpecName "kube-api-access-vknv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:29.209418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.209363    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert" pod "7c852253-471e-4b21-87aa-22aa4ff8c454" (UID: "7c852253-471e-4b21-87aa-22aa4ff8c454"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:16:29.308756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.308714    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:29.308756 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.308759    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vknv4\" (UniqueName: \"kubernetes.io/projected/7c852253-471e-4b21-87aa-22aa4ff8c454-kube-api-access-vknv4\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:29.308951 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.308776    4958 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c852253-471e-4b21-87aa-22aa4ff8c454-webhook-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:29.409525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.409440    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:29.584566 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:29.584523    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:16:29.590341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.590313    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:29.746363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.746326    4958 generic.go:356] "Generic (PLEG): container finished" podID="7c852253-471e-4b21-87aa-22aa4ff8c454" containerID="009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701" exitCode=0
Oct 31 13:16:29.746579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.746380    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh"
Oct 31 13:16:29.746579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.746416    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" event={"ID":"7c852253-471e-4b21-87aa-22aa4ff8c454","Type":"ContainerDied","Data":"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"}
Oct 31 13:16:29.746579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.746481    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-bzllh" event={"ID":"7c852253-471e-4b21-87aa-22aa4ff8c454","Type":"ContainerDied","Data":"c223e83a66f822aeebcfcaecaff71bc13f191434c40c9dc8a1b103b8dd677959"}
Oct 31 13:16:29.746579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.746515    4958 scope.go:122] "RemoveContainer" containerID="009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"
Oct 31 13:16:29.759207 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.759184    4958 scope.go:122] "RemoveContainer" containerID="009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"
Oct 31 13:16:29.759556 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:29.759534    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701\": container with ID starting with 009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701 not found: ID does not exist" containerID="009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"
Oct 31 13:16:29.759636 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.759568    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701"} err="failed to get container status \"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701\": rpc error: code = NotFound desc = could not find container \"009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701\": container with ID starting with 009db43f881bfa4091c68f1216a9409867ba55e5dc705170ea67d1a7a05d2701 not found: ID does not exist"
Oct 31 13:16:29.788536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.788500    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:16:29.803242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:29.795437    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-bzllh"]
Oct 31 13:16:30.491473 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.491438    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c852253-471e-4b21-87aa-22aa4ff8c454" path="/var/lib/kubelet/pods/7c852253-471e-4b21-87aa-22aa4ff8c454/volumes"
Oct 31 13:16:30.560337 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560297    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:16:30.560870 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560851    4958 cpu_manager.go:414] "containerMap: removing container" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560870    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560883    4958 cpu_manager.go:414] "containerMap: removing container" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560888    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560901    4958 cpu_manager.go:414] "containerMap: removing container" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560905    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560912    4958 cpu_manager.go:414] "containerMap: removing container" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560916    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560925    4958 cpu_manager.go:414] "containerMap: removing container" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560929    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560939    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy"
Oct 31 13:16:30.560961 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560944    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560975    4958 cpu_manager.go:414] "containerMap: removing container" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.560983    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561000    4958 cpu_manager.go:414] "containerMap: removing container" podUID="61d26977-831b-4a07-a5b5-dad023202527" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561006    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61d26977-831b-4a07-a5b5-dad023202527" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561020    4958 cpu_manager.go:414] "containerMap: removing container" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561028    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561037    4958 cpu_manager.go:414] "containerMap: removing container" podUID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561045    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561056    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7c852253-471e-4b21-87aa-22aa4ff8c454" containerName="manager"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561060    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c852253-471e-4b21-87aa-22aa4ff8c454" containerName="manager"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561067    4958 cpu_manager.go:414] "containerMap: removing container" podUID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561071    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561077    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561081    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561087    4958 cpu_manager.go:414] "containerMap: removing container" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561093    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561105    4958 cpu_manager.go:414] "containerMap: removing container" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561110    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561126    4958 cpu_manager.go:414] "containerMap: removing container" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561132    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561139    4958 cpu_manager.go:414] "containerMap: removing container" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561143    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561149    4958 cpu_manager.go:414] "containerMap: removing container" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561154    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561161    4958 cpu_manager.go:414] "containerMap: removing container" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561165    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561173    4958 cpu_manager.go:414] "containerMap: removing container" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561178    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561188    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561192    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561200    4958 cpu_manager.go:414] "containerMap: removing container" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561204    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561238    4958 cpu_manager.go:414] "containerMap: removing container" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561247    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561258    4958 cpu_manager.go:414] "containerMap: removing container" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561265    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561277    4958 cpu_manager.go:414] "containerMap: removing container" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561283    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561290    4958 cpu_manager.go:414] "containerMap: removing container" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561294    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561388    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="228b0819-9f58-4ea0-8020-361205000f2a" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561400    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2169535-a6f1-4888-9ade-adf32976a82a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561412    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d796daa-8bc1-481c-87e1-9ef86af9dbfd" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561419    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9fd0ca-bb43-49e0-bbf2-3006262effaf" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561423    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="35981ba1-2c78-41ef-a7ca-c16952d72669" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561429    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c749dd-f9f6-438c-b8ef-1d628ff1bc32" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561433    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0154ebc-3756-4828-8d26-91a23b33455d" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561439    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eeed622-73ae-4d52-9985-ea079cac05d9" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561444    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc0ccd25-8f64-4eda-b8b8-0a8ac88b6335" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561450    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="cedd26c4-de10-4701-88ce-819467dd3c05" containerName="main"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561456    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c7cdee4-3ef1-473a-a921-394ff5ff947f" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561462    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="1593a303-7a9f-48b8-a063-faafeed228a8" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561467    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="b81b9a5a-83a9-4477-bee5-a8b0c091f696" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561472    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="a621e490-a4d4-4b69-9870-aff6bdad4b56" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561478    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="61d26977-831b-4a07-a5b5-dad023202527" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561483    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="9164fd1f-c692-449b-8fa3-51bf89b7d97a" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561490    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d8db944-8073-4ac0-9ef9-2b92bf766a3e" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561496    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c852253-471e-4b21-87aa-22aa4ff8c454" containerName="manager"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561502    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="a918740e-9f94-483b-8837-6ccd8ae2a6a0" containerName="maas-api"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561509    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9940156-4289-4652-a1cc-29538fb10f5c" containerName="main"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561515    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5d5dac2-f0e0-4948-b200-b72440b16930" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561523    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d23592c-3c08-4562-bde6-895b1a25bedf" containerName="payload-pre-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561529    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="2df344e9-34f5-4e4c-a5ed-ffd23ac7820a" containerName="payload-processing"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561534    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="72b0dc49-dc42-41a6-b363-15cedf50afaa" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561540    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="57121605-f2c9-4d15-b7f8-ce8d688f712c" containerName="istio-proxy"
Oct 31 13:16:30.561510 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.561546    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2fb32db-e0b7-479a-a42f-6b4c9e1c0796" containerName="istio-proxy"
Oct 31 13:16:30.576326 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.576297    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.586408 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.586373    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:16:30.587962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.587812    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 13:16:30.587962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.587871    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 13:16:30.587962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.587919    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 13:16:30.587962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.587952    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sj2wv\""
Oct 31 13:16:30.593566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.593281    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:30.593566 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.593356    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:30.656455 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.656412    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 13:16:30.656647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.656475    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 13:16:30.725884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.725842    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn97k\" (UniqueName: \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.726077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.725977    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.726077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.726009    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.827706 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.827483    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.827706 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.827581    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.829190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.828684    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn97k\" (UniqueName: \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.838539 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.832902    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.838539 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.833089    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.846827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.846750    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn97k\" (UniqueName: \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\") pod \"maas-controller-bd9ffcfc7-m8tr7\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") " pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:30.896351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:30.896284    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:31.040470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.040368    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:31.247161 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.245104    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:16:31.295027 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:16:31.294986    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c361304_e583_4dee_aa5a_8e1e7edc48ae.slice/crio-03bd312f2a53e87b035f02d34dddc9cadc50881402c3be2288b5e8125bd56565 WatchSource:0}: Error finding container 03bd312f2a53e87b035f02d34dddc9cadc50881402c3be2288b5e8125bd56565: Status 404 returned error can't find the container with id 03bd312f2a53e87b035f02d34dddc9cadc50881402c3be2288b5e8125bd56565
Oct 31 13:16:31.297013 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.296985    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:16:31.476021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.475714    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:16:31.543622 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543060    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543653    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543708    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543761    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543812    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.543987    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544088 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.544059    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.544110    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.544475 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.544195    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\") pod \"8067a1b9-57a7-4cf7-b287-74646d2fb036\" (UID: \"8067a1b9-57a7-4cf7-b287-74646d2fb036\") "
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.544803    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.545885    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.545979    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.546056    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.546517    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8067a1b9-57a7-4cf7-b287-74646d2fb036-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.546542    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.546559    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.546646 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.546574    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.547419 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.547276    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.547852 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.547827    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.549383 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.549354    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:31.550043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.549686    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:16:31.550995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.550966    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "kube-api-access-8n75n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:31.552136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.552107    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo" pod "8067a1b9-57a7-4cf7-b287-74646d2fb036" (UID: "8067a1b9-57a7-4cf7-b287-74646d2fb036"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:31.647738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.647696    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.647978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.647803    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.647978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.647840    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.647978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.647915    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.647978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.647973    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.648355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648002    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.648355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648047    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.648355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648091    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.648355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648120    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\") pod \"6085accf-11b6-4de1-b73a-e251162abb34\" (UID: \"6085accf-11b6-4de1-b73a-e251162abb34\") "
Oct 31 13:16:31.648693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648522    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.648693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648546    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.648693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648561    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8067a1b9-57a7-4cf7-b287-74646d2fb036-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.648693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648575    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8067a1b9-57a7-4cf7-b287-74646d2fb036-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.648693 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.648588    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n75n\" (UniqueName: \"kubernetes.io/projected/8067a1b9-57a7-4cf7-b287-74646d2fb036-kube-api-access-8n75n\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.650760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.650627    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:31.651046 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.650999    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.651123 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.651058    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.651321 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.651297    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.651457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.651418    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.652102 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.652073    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "kube-api-access-89rwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:31.653457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.653435    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:31.653936 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.653915    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:31.655274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.655245    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token" pod "6085accf-11b6-4de1-b73a-e251162abb34" (UID: "6085accf-11b6-4de1-b73a-e251162abb34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749519    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749571    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749587    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89rwd\" (UniqueName: \"kubernetes.io/projected/6085accf-11b6-4de1-b73a-e251162abb34-kube-api-access-89rwd\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749656    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6085accf-11b6-4de1-b73a-e251162abb34-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749674    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749689    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749705    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749720    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6085accf-11b6-4de1-b73a-e251162abb34-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.749765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.749735    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6085accf-11b6-4de1-b73a-e251162abb34-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:31.784803 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.784758    4958 generic.go:356] "Generic (PLEG): container finished" podID="6085accf-11b6-4de1-b73a-e251162abb34" containerID="8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc" exitCode=0
Oct 31 13:16:31.785006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.784938    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" event={"ID":"6085accf-11b6-4de1-b73a-e251162abb34","Type":"ContainerDied","Data":"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"}
Oct 31 13:16:31.785006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.784998    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" event={"ID":"6085accf-11b6-4de1-b73a-e251162abb34","Type":"ContainerDied","Data":"f70a04f3ba25ba4d29a25e9e7051ecd157d558c5227aeae87ad941348d6e5675"}
Oct 31 13:16:31.785116 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.785032    4958 scope.go:122] "RemoveContainer" containerID="8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"
Oct 31 13:16:31.785224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.785204    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"
Oct 31 13:16:31.792718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.792684    4958 generic.go:356] "Generic (PLEG): container finished" podID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerID="535f2e68c865266a5718ced9792c5218758db7459cc2fa5afa58c2654142cedf" exitCode=0
Oct 31 13:16:31.793221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.793003    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" event={"ID":"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0","Type":"ContainerDied","Data":"535f2e68c865266a5718ced9792c5218758db7459cc2fa5afa58c2654142cedf"}
Oct 31 13:16:31.796212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.796111    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" event={"ID":"6c361304-e583-4dee-aa5a-8e1e7edc48ae","Type":"ContainerStarted","Data":"03bd312f2a53e87b035f02d34dddc9cadc50881402c3be2288b5e8125bd56565"}
Oct 31 13:16:31.797154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.797127    4958 generic.go:356] "Generic (PLEG): container finished" podID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerID="5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff" exitCode=0
Oct 31 13:16:31.797351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.797331    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" event={"ID":"8067a1b9-57a7-4cf7-b287-74646d2fb036","Type":"ContainerDied","Data":"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"}
Oct 31 13:16:31.797498 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.797482    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn" event={"ID":"8067a1b9-57a7-4cf7-b287-74646d2fb036","Type":"ContainerDied","Data":"18422a7d69ccb2745e3752ba813ce53f75d2475e694bb0f0f422552ada3d4b23"}
Oct 31 13:16:31.797687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.797668    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"
Oct 31 13:16:31.813110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.813072    4958 scope.go:122] "RemoveContainer" containerID="8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"
Oct 31 13:16:31.814666 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:31.814634    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc\": container with ID starting with 8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc not found: ID does not exist" containerID="8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"
Oct 31 13:16:31.814787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.814678    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc"} err="failed to get container status \"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc\": rpc error: code = NotFound desc = could not find container \"8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc\": container with ID starting with 8347ee4ff790e2c6ae44800b1905e3a1c7697c69bed9c8085096715b46188bdc not found: ID does not exist"
Oct 31 13:16:31.814787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.814703    4958 scope.go:122] "RemoveContainer" containerID="5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"
Oct 31 13:16:31.884878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.884433    4958 scope.go:122] "RemoveContainer" containerID="5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"
Oct 31 13:16:31.885437 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:31.885279    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff\": container with ID starting with 5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff not found: ID does not exist" containerID="5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"
Oct 31 13:16:31.886988 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.885329    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff"} err="failed to get container status \"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff\": rpc error: code = NotFound desc = could not find container \"5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff\": container with ID starting with 5b57add51f6c5536089751ef4c5f7508728221204b4dad48890109e8859513ff not found: ID does not exist"
Oct 31 13:16:31.898637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.898112    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:16:31.909251 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.909114    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x"]
Oct 31 13:16:31.912207 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.912176    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:16:31.940632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:31.916430    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-x88jn"]
Oct 31 13:16:32.172272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.171912    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318464    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318532    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318584    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318633    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318693    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318763    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318821    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318872    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.324691 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.318901    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\") pod \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\" (UID: \"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0\") "
Oct 31 13:16:32.333178 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.332747    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:32.336533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.335492    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:32.336533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.335728    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:32.336533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.336414    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:16:32.336533 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.336489    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:32.411881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.411808    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:16:32.411881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.411841    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:32.412409 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.412374    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "kube-api-access-6m9v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:16:32.413035 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.412993    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo" pod "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" (UID: "75531de2-e94c-4ffb-8abe-fdf4dfbc08c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423409    4958 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423442    4958 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-envoy\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423459    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423474    4958 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-data\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423489    4958 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istio-podinfo\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423503    4958 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-istiod-ca-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423517    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m9v4\" (UniqueName: \"kubernetes.io/projected/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-kube-api-access-6m9v4\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423535    4958 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-workload-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.440854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.423553    4958 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0-credential-socket\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:16:32.510644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.506822    4958 patch_prober.go:29] interesting pod/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:16:32.510644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.506887    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-w957x" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:16:32.513403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.513365    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6085accf-11b6-4de1-b73a-e251162abb34" path="/var/lib/kubelet/pods/6085accf-11b6-4de1-b73a-e251162abb34/volumes"
Oct 31 13:16:32.514114 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.514089    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" path="/var/lib/kubelet/pods/8067a1b9-57a7-4cf7-b287-74646d2fb036/volumes"
Oct 31 13:16:32.815552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.815522    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"
Oct 31 13:16:32.816180 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.815550    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj" event={"ID":"75531de2-e94c-4ffb-8abe-fdf4dfbc08c0","Type":"ContainerDied","Data":"c1491de79b56dd33f4e3fa4172c8886ee9ae6f2ac07df6091bed7818c0081cf5"}
Oct 31 13:16:32.816303 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.816209    4958 scope.go:122] "RemoveContainer" containerID="535f2e68c865266a5718ced9792c5218758db7459cc2fa5afa58c2654142cedf"
Oct 31 13:16:32.842906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.817971    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" event={"ID":"6c361304-e583-4dee-aa5a-8e1e7edc48ae","Type":"ContainerStarted","Data":"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"}
Oct 31 13:16:32.842906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.818639    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:32.874995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:32.874928    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" podStartSLOduration=1.9720187660000001 podStartE2EDuration="2.87490635s" totalImagesPullingTime="902.887584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:16:32.873216369 +0000 UTC m=+1014.536642073" watchObservedRunningTime="2026-10-31 13:16:32.87490635 +0000 UTC m=+1014.538332037"
Oct 31 13:16:33.042751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:33.042692    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:16:33.074629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:33.073443    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7bf66c-openshift-default-b6bbf7965-jhwnj"]
Oct 31 13:16:33.213935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:33.213885    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:33.913815 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:33.913764    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:34.490711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:34.490678    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" path="/var/lib/kubelet/pods/75531de2-e94c-4ffb-8abe-fdf4dfbc08c0/volumes"
Oct 31 13:16:37.361525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:37.361483    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:16:44.861921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:16:44.861882    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:16:59.578437 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:16:59.578343    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:17:02.589941 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:02.589898    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:02.674103 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:02.674069    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:17:02.674345 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:02.674321    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" podUID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" containerName="manager" containerID="cri-o://98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238" gracePeriod=30
Oct 31 13:17:02.937312 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:02.937284    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:17:03.043415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.043378    4958 generic.go:356] "Generic (PLEG): container finished" podID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" containerID="98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238" exitCode=0
Oct 31 13:17:03.043637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.043430    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7"
Oct 31 13:17:03.043637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.043465    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" event={"ID":"6c361304-e583-4dee-aa5a-8e1e7edc48ae","Type":"ContainerDied","Data":"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"}
Oct 31 13:17:03.043637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.043529    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-m8tr7" event={"ID":"6c361304-e583-4dee-aa5a-8e1e7edc48ae","Type":"ContainerDied","Data":"03bd312f2a53e87b035f02d34dddc9cadc50881402c3be2288b5e8125bd56565"}
Oct 31 13:17:03.043637 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.043593    4958 scope.go:122] "RemoveContainer" containerID="98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"
Oct 31 13:17:03.053388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.053364    4958 scope.go:122] "RemoveContainer" containerID="98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"
Oct 31 13:17:03.053821 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:17:03.053795    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238\": container with ID starting with 98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238 not found: ID does not exist" containerID="98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"
Oct 31 13:17:03.053884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.053833    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238"} err="failed to get container status \"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238\": rpc error: code = NotFound desc = could not find container \"98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238\": container with ID starting with 98658353308b6c09307a9988121c7a474961172ffad5a15c1b5ab11a4356c238 not found: ID does not exist"
Oct 31 13:17:03.109577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.109485    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\") pod \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") "
Oct 31 13:17:03.109577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.109535    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\" (UniqueName: \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\") pod \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") "
Oct 31 13:17:03.109803 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.109738    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\") pod \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\" (UID: \"6c361304-e583-4dee-aa5a-8e1e7edc48ae\") "
Oct 31 13:17:03.111785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.111747    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert" pod "6c361304-e583-4dee-aa5a-8e1e7edc48ae" (UID: "6c361304-e583-4dee-aa5a-8e1e7edc48ae"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:17:03.111921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.111781    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs" pod "6c361304-e583-4dee-aa5a-8e1e7edc48ae" (UID: "6c361304-e583-4dee-aa5a-8e1e7edc48ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:17:03.111921 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.111850    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k" pod "6c361304-e583-4dee-aa5a-8e1e7edc48ae" (UID: "6c361304-e583-4dee-aa5a-8e1e7edc48ae"). InnerVolumeSpecName "kube-api-access-cn97k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:17:03.211350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.211311    4958 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-webhook-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:17:03.211350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.211347    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c361304-e583-4dee-aa5a-8e1e7edc48ae-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:17:03.211350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.211358    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn97k\" (UniqueName: \"kubernetes.io/projected/6c361304-e583-4dee-aa5a-8e1e7edc48ae-kube-api-access-cn97k\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:17:03.240773 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.240728    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:03.369779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.369692    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:17:03.374662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:03.374627    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-m8tr7"]
Oct 31 13:17:04.425434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.425398    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:04.490752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.490722    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" path="/var/lib/kubelet/pods/6c361304-e583-4dee-aa5a-8e1e7edc48ae/volumes"
Oct 31 13:17:04.521434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521399    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-88nxh"]
Oct 31 13:17:04.521877 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521862    4958 cpu_manager.go:414] "containerMap: removing container" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy"
Oct 31 13:17:04.521929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521878    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy"
Oct 31 13:17:04.521929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521895    4958 cpu_manager.go:414] "containerMap: removing container" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy"
Oct 31 13:17:04.521929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521901    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521931    4958 cpu_manager.go:414] "containerMap: removing container" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521936    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521947    4958 cpu_manager.go:414] "containerMap: removing container" podUID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" containerName="manager"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.521951    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" containerName="manager"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.522013    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="75531de2-e94c-4ffb-8abe-fdf4dfbc08c0" containerName="istio-proxy"
Oct 31 13:17:04.522022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.522021    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c361304-e583-4dee-aa5a-8e1e7edc48ae" containerName="manager"
Oct 31 13:17:04.522198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.522028    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="8067a1b9-57a7-4cf7-b287-74646d2fb036" containerName="istio-proxy"
Oct 31 13:17:04.522198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.522036    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="6085accf-11b6-4de1-b73a-e251162abb34" containerName="istio-proxy"
Oct 31 13:17:04.525462 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.525437    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.534224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.534198    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 13:17:04.534635 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.534583    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sj2wv\""
Oct 31 13:17:04.534779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.534236    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 13:17:04.534866 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.534812    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 13:17:04.537393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.537369    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-88nxh"]
Oct 31 13:17:04.626177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.626134    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4v68\" (UniqueName: \"kubernetes.io/projected/3456e033-eb8e-4101-842b-fb39109929e5-kube-api-access-t4v68\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.626393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.626305    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-webhook-cert\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.626579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.626552    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-metrics-certs\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.727479 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.727431    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-webhook-cert\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.727704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.727547    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-metrics-certs\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.727704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.727582    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4v68\" (UniqueName: \"kubernetes.io/projected/3456e033-eb8e-4101-842b-fb39109929e5-kube-api-access-t4v68\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.730253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.730218    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-webhook-cert\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.730253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.730245    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3456e033-eb8e-4101-842b-fb39109929e5-metrics-certs\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.741859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.741826    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4v68\" (UniqueName: \"kubernetes.io/projected/3456e033-eb8e-4101-842b-fb39109929e5-kube-api-access-t4v68\") pod \"maas-controller-bd9ffcfc7-88nxh\" (UID: \"3456e033-eb8e-4101-842b-fb39109929e5\") " pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:04.843362 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:04.843323    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:05.127638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:05.127583    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bd9ffcfc7-88nxh"]
Oct 31 13:17:05.128982 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:17:05.128949    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3456e033_eb8e_4101_842b_fb39109929e5.slice/crio-887a13eb5da0569983c31d62848b1f7dc98620a513809947968088ce822fd10d WatchSource:0}: Error finding container 887a13eb5da0569983c31d62848b1f7dc98620a513809947968088ce822fd10d: Status 404 returned error can't find the container with id 887a13eb5da0569983c31d62848b1f7dc98620a513809947968088ce822fd10d
Oct 31 13:17:06.072798 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:06.072760    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh" event={"ID":"3456e033-eb8e-4101-842b-fb39109929e5","Type":"ContainerStarted","Data":"8984c8e15ee8fa56dbb0d5d475a47458d07e70ea310b54d17ae8fef6f23017a2"}
Oct 31 13:17:06.073236 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:06.072821    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh" event={"ID":"3456e033-eb8e-4101-842b-fb39109929e5","Type":"ContainerStarted","Data":"887a13eb5da0569983c31d62848b1f7dc98620a513809947968088ce822fd10d"}
Oct 31 13:17:06.073236 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:06.072868    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:06.097139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:06.097080    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh" podStartSLOduration=1.674824245 podStartE2EDuration="2.097066369s" totalImagesPullingTime="422.242124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:17:06.094791629 +0000 UTC m=+1047.758217391" watchObservedRunningTime="2026-10-31 13:17:06.097066369 +0000 UTC m=+1047.760492079"
Oct 31 13:17:06.943666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:06.943628    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:07.082585 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:07.082548    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:17.081541 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:17.081502    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bd9ffcfc7-88nxh"
Oct 31 13:17:29.457707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:29.457669    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:29.579449 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:17:29.579410    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:17:35.025459 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:35.025421    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"]
Oct 31 13:17:35.032860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:35.032821    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7fe862c2-lxt4v"]
Oct 31 13:17:36.490993 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:36.490955    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1" path="/var/lib/kubelet/pods/98d2cf1e-29d4-41f2-80b9-4c20eb49c6e1/volumes"
Oct 31 13:17:57.901306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:17:57.901256    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:17:59.711973 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:17:59.711925    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:18:29.549410 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:18:29.549313    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:18:29.578012 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:18:29.577969    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:18:39.206929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:18:39.206892    4958 scope.go:122] "RemoveContainer" containerID="7d9770c47112293f7dd0c7ba8a9b2f9e2d56c23f8543239b895528ed2ca7581d"
Oct 31 13:18:59.573198 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:18:59.573141    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:19:08.722632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:08.721854    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:19:08.722632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:08.721934    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:19:29.628595 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:29.628558    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:19:29.722060 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:19:29.722026    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:19:39.230820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:39.230787    4958 scope.go:122] "RemoveContainer" containerID="7838f20360f0bc8712161a0e3fb0db590a433bdcdb5bc38e6dcda6601bb5b487"
Oct 31 13:19:40.176068 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:40.176040    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:19:40.182705 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:40.182680    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:19:40.312011 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:40.311980    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:19:40.318858 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:40.318834    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:19:50.082826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:50.082717    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:19:50.083597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:50.083557    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:19:58.165754 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:58.165716    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:19:59.231951 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:19:59.231909    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:19:59.572732 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:19:59.572645    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:20:08.730259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:08.729728    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:20:08.730259 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:08.729805    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:20:17.032097 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:17.032061    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"]
Oct 31 13:20:17.035914 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:17.035885    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0a049f62-v6gpv"]
Oct 31 13:20:18.491768 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:18.491727    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9833e49-dc30-40cd-af38-830f607dc68d" path="/var/lib/kubelet/pods/f9833e49-dc30-40cd-af38-830f607dc68d/volumes"
Oct 31 13:20:29.573940 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:20:29.573896    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:20:29.721491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:29.721449    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:20:35.077630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:35.076738    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-58mdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:20:35.077630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:35.076853    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-58mdk" podUID="8004ca3a-1ba4-4031-a3a0-8daf23610852" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:20:37.485632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:37.484639    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bmrjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:20:37.485632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:37.484813    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bmrjc" podUID="f3e7c5fa-8d1f-4eeb-b751-29f89354870f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:20:50.033865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:50.033828    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"]
Oct 31 13:20:50.038346 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:50.038312    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-50a39045-f24t7"]
Oct 31 13:20:50.490618 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:20:50.490575    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0c58ced-45ef-498d-b1f7-82247540130b" path="/var/lib/kubelet/pods/d0c58ced-45ef-498d-b1f7-82247540130b/volumes"
Oct 31 13:20:59.572174 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:20:59.572119    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:21:29.574670 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:21:29.574567    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:21:29.771562 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:29.771509    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:21:36.281987 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.281947    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:21:36.282847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.282214    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery" containerID="cri-o://fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361" gracePeriod=30
Oct 31 13:21:36.575005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.574976    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:21:36.691432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691394    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691453    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691481    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691517    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691571    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691672 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691658    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.691962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.691704    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\") pod \"5535bbe4-b2fe-4d46-b691-949a68e470e7\" (UID: \"5535bbe4-b2fe-4d46-b691-949a68e470e7\") "
Oct 31 13:21:36.711736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.692376    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:21:36.711736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.710330    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:21:36.711736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.710434    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:21:36.711736 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.710493    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:21:36.712334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.712241    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:21:36.712334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.712288    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:21:36.713686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.713660    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls" pod "5535bbe4-b2fe-4d46-b691-949a68e470e7" (UID: "5535bbe4-b2fe-4d46-b691-949a68e470e7"). InnerVolumeSpecName "kube-api-access-mw5ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:21:36.793371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793321    4958 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-kubeconfig\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793368    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw5ls\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-kube-api-access-mw5ls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793384    4958 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-dns-cert\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793397    4958 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-csr-ca-configmap\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793410    4958 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5535bbe4-b2fe-4d46-b691-949a68e470e7-local-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793422    4958 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5535bbe4-b2fe-4d46-b691-949a68e470e7-istio-token\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:36.793620 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:36.793433    4958 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5535bbe4-b2fe-4d46-b691-949a68e470e7-cacerts\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:37.002037 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.001997    4958 generic.go:356] "Generic (PLEG): container finished" podID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerID="fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361" exitCode=0
Oct 31 13:21:37.002197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.002057    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"
Oct 31 13:21:37.002197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.002085    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" event={"ID":"5535bbe4-b2fe-4d46-b691-949a68e470e7","Type":"ContainerDied","Data":"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"}
Oct 31 13:21:37.002197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.002168    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt" event={"ID":"5535bbe4-b2fe-4d46-b691-949a68e470e7","Type":"ContainerDied","Data":"d62c17ca6bba9151ae903c615375c694bc385328e9c79d1fdc028f34e4c19cd4"}
Oct 31 13:21:37.002197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.002193    4958 scope.go:122] "RemoveContainer" containerID="fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"
Oct 31 13:21:37.012924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.012899    4958 scope.go:122] "RemoveContainer" containerID="fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"
Oct 31 13:21:37.013318 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:21:37.013290    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361\": container with ID starting with fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361 not found: ID does not exist" containerID="fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"
Oct 31 13:21:37.013406 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.013329    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361"} err="failed to get container status \"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361\": rpc error: code = NotFound desc = could not find container \"fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361\": container with ID starting with fbc7ba87055f804ed1e441e335d644d064fa96d55b142349a805b15068354361 not found: ID does not exist"
Oct 31 13:21:37.029599 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.029571    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:21:37.034597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:37.034570    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5dfxt"]
Oct 31 13:21:38.491333 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:38.491299    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" path="/var/lib/kubelet/pods/5535bbe4-b2fe-4d46-b691-949a68e470e7/volumes"
Oct 31 13:21:39.265113 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:39.265076    4958 scope.go:122] "RemoveContainer" containerID="0b366bcabbdcac0479dcd9dd9b29569904d969168f38470a256a7316d9b46c22"
Oct 31 13:21:40.876085 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.876047    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"]
Oct 31 13:21:40.876528 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.876513    4958 cpu_manager.go:414] "containerMap: removing container" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery"
Oct 31 13:21:40.876573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.876529    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery"
Oct 31 13:21:40.876651 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.876641    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="5535bbe4-b2fe-4d46-b691-949a68e470e7" containerName="discovery"
Oct 31 13:21:40.881509 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.881489    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:40.886984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.886957    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:21:40.887144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.887099    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:21:40.889690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.889660    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"]
Oct 31 13:21:40.931213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.931175    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:40.931378 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.931257    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:40.931485 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:40.931457    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b8wr\" (UniqueName: \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.033156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.033105    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b8wr\" (UniqueName: \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.033355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.033253    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.033355 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.033285    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.034055 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.034029    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.035644 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.035600    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.047225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.047202    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b8wr\" (UniqueName: \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\") pod \"maas-api-revoke-sub-3d4156f1-qt4vl\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.198153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.198067    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:41.478505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:41.478472    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"]
Oct 31 13:21:41.480069 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:21:41.480040    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f64660f_45d1_4420_8c6b_44bc5cbb2e40.slice/crio-096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3 WatchSource:0}: Error finding container 096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3: Status 404 returned error can't find the container with id 096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3
Oct 31 13:21:42.034663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:42.034574    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl" event={"ID":"4f64660f-45d1-4420-8c6b-44bc5cbb2e40","Type":"ContainerStarted","Data":"98b82a5303a5d4baae90af364747fc2a7845a77d955baabdc44623e245057679"}
Oct 31 13:21:42.034663 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:42.034638    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl" event={"ID":"4f64660f-45d1-4420-8c6b-44bc5cbb2e40","Type":"ContainerStarted","Data":"096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3"}
Oct 31 13:21:42.055812 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:42.055765    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl" podStartSLOduration=2.055752931 podStartE2EDuration="2.055752931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:21:42.054933193 +0000 UTC m=+1323.718358877" watchObservedRunningTime="2026-10-31 13:21:42.055752931 +0000 UTC m=+1323.719178614"
Oct 31 13:21:43.041897 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:43.041861    4958 generic.go:356] "Generic (PLEG): container finished" podID="4f64660f-45d1-4420-8c6b-44bc5cbb2e40" containerID="98b82a5303a5d4baae90af364747fc2a7845a77d955baabdc44623e245057679" exitCode=0
Oct 31 13:21:43.042375 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:43.041951    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl" event={"ID":"4f64660f-45d1-4420-8c6b-44bc5cbb2e40","Type":"ContainerDied","Data":"98b82a5303a5d4baae90af364747fc2a7845a77d955baabdc44623e245057679"}
Oct 31 13:21:44.188938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.188911    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:44.266065 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.266018    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\") pod \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") "
Oct 31 13:21:44.266247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.266202    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\" (UniqueName: \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\") pod \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") "
Oct 31 13:21:44.266247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.266231    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\") pod \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\" (UID: \"4f64660f-45d1-4420-8c6b-44bc5cbb2e40\") "
Oct 31 13:21:44.266724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.266695    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca" pod "4f64660f-45d1-4420-8c6b-44bc5cbb2e40" (UID: "4f64660f-45d1-4420-8c6b-44bc5cbb2e40"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:21:44.268159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.268138    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca" pod "4f64660f-45d1-4420-8c6b-44bc5cbb2e40" (UID: "4f64660f-45d1-4420-8c6b-44bc5cbb2e40"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:21:44.268367 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.268354    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr" pod "4f64660f-45d1-4420-8c6b-44bc5cbb2e40" (UID: "4f64660f-45d1-4420-8c6b-44bc5cbb2e40"). InnerVolumeSpecName "kube-api-access-4b8wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:21:44.367332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.367246    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b8wr\" (UniqueName: \"kubernetes.io/projected/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-kube-api-access-4b8wr\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:44.367332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.367278    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:44.367332 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:44.367290    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4f64660f-45d1-4420-8c6b-44bc5cbb2e40-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:21:45.055407 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:45.055368    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl" event={"ID":"4f64660f-45d1-4420-8c6b-44bc5cbb2e40","Type":"ContainerDied","Data":"096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3"}
Oct 31 13:21:45.055593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:45.055424    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="096ed85620a901d0e538a589290e038f4eb8aa8851a26e0ef82fe72dc856f6b3"
Oct 31 13:21:45.055593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:21:45.055382    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"
Oct 31 13:21:59.579262 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:21:59.579223    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:22:02.283848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:02.283811    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:02.722395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:02.722344    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:02.863260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:02.863209    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:06.119261 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:06.119219    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:06.254070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:06.254036    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:07.302817 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.302774    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:22:07.303315 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.303271    4958 cpu_manager.go:414] "containerMap: removing container" podUID="4f64660f-45d1-4420-8c6b-44bc5cbb2e40" containerName="revoke-keys"
Oct 31 13:22:07.303315 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.303286    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f64660f-45d1-4420-8c6b-44bc5cbb2e40" containerName="revoke-keys"
Oct 31 13:22:07.303399 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.303361    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f64660f-45d1-4420-8c6b-44bc5cbb2e40" containerName="revoke-keys"
Oct 31 13:22:07.306460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.306441    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.315857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.315830    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-25d309-serving-cert\""
Oct 31 13:22:07.316411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.316273    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 13:22:07.318984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.318946    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2hbvg\""
Oct 31 13:22:07.321212 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.321180    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:22:07.329972 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.329924    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbnbn\" (UniqueName: \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.330198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.330156    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.330267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.330253    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.330361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.330338    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.351538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.351500    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:07.431947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.431912    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.432148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.431962    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.432148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.432084    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbnbn\" (UniqueName: \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.432284 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.432269    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.432435 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:22:07.432410    4958 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-serving-cert: secret "maas-api-e2e-worker-single-main-25d309-serving-cert" not found
Oct 31 13:22:07.432546 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:22:07.432482    4958 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls podName:fe5ddb14-d160-4123-b6c3-c3c1bdfcec94 nodeName:}" failed. No retries permitted until 2026-10-31 13:22:07.932465323 +0000 UTC m=+1349.595890985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls") pod "maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" (UID: "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94") : secret "maas-api-e2e-worker-single-main-25d309-serving-cert" not found
Oct 31 13:22:07.432763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.432744    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.434702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.434682    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.449078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.449053    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbnbn\" (UniqueName: \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.483041 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.483012    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:07.692165 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.692047    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:07.938125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.938081    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:07.940859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:07.940830    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-25d309-674978bf69-448dc\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:08.224790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:08.224755    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:08.267145 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:08.267102    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:08.531002 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:08.530970    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:22:08.532839 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:22:08.532809    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5ddb14_d160_4123_b6c3_c3c1bdfcec94.slice/crio-183235550a4c3b315f577bed93dc27907c6ec84796be7d013a918cfcbb8fac2d WatchSource:0}: Error finding container 183235550a4c3b315f577bed93dc27907c6ec84796be7d013a918cfcbb8fac2d: Status 404 returned error can't find the container with id 183235550a4c3b315f577bed93dc27907c6ec84796be7d013a918cfcbb8fac2d
Oct 31 13:22:08.534235 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:08.534216    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:22:09.189502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.189388    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:09.222405 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.222355    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" event={"ID":"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94","Type":"ContainerStarted","Data":"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"}
Oct 31 13:22:09.222574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.222424    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" event={"ID":"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94","Type":"ContainerStarted","Data":"183235550a4c3b315f577bed93dc27907c6ec84796be7d013a918cfcbb8fac2d"}
Oct 31 13:22:09.224266 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.224239    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:09.248554 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.248501    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" podStartSLOduration=1.8446843510000002 podStartE2EDuration="2.248486396s" totalImagesPullingTime="403.802045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:22:09.24612386 +0000 UTC m=+1350.909549547" watchObservedRunningTime="2026-10-31 13:22:09.248486396 +0000 UTC m=+1350.911912110"
Oct 31 13:22:09.911014 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:09.910975    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:10.890979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:10.890924    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:11.609460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:11.609418    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:12.424242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:12.424208    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:13.283122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:13.283086    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:14.046894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:14.046841    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:14.799583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:14.799541    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:15.602527 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:15.602493    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:16.243061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:16.243033    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:22:16.385787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:16.385750    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:17.151144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:17.151103    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:17.965962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:17.965753    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:18.884509 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:18.884469    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:19.603780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:19.603746    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:20.386810 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:20.386773    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:21.164017 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:21.163975    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:21.306849 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:21.306794    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:21.811458 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:21.811426    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:21.949004 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:21.948963    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:22.078404 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:22.078304    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:22.210857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:22.210827    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:22.902154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:22.902117    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:23.502935 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:23.502888    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:23.724576 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:23.724542    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:24.554397 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:24.554359    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:25.631255 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:25.631191    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:26.297416 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:26.297382    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:27.192238 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:27.192201    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:27.903536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:27.903501    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:28.701913 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:28.701885    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:29.480559 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:29.480525    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:29.572841 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:22:29.572804    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:22:29.821411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:29.821321    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:30.270723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:30.270693    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:30.994359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:30.994323    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:31.765737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:31.765695    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:32.504026 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:32.503982    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:33.295981 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:33.295944    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:34.081836 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:34.081780    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:34.810911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:34.810868    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:35.589330 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:35.589293    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:36.378593 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:36.378544    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:37.149586 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:37.149542    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:37.895528 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:37.895490    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:38.799655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:38.799591    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:39.294000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:39.293957    4958 scope.go:122] "RemoveContainer" containerID="303802075ac8c7ac34d0e62085d8c699dcc42802efe704e439fe7b06ed0c1aad"
Oct 31 13:22:39.597553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:39.597455    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:40.354227 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:40.354187    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:41.290650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:41.290544    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:42.209595 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:42.209548    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:42.980868 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:42.980837    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:43.811208 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:43.811158    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:44.579671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:44.579638    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:45.312313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:45.312226    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:46.093718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:46.093667    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:46.896338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:46.896298    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:47.692445 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:47.692413    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:48.397902 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:48.397868    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:49.112826 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:49.112782    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:49.905525 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:49.905438    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:50.686522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:50.686472    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:51.438079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:51.438034    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:52.203110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:52.203073    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:52.989726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:52.989693    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:53.955724 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:53.955694    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:54.600564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:54.600527    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:55.418237 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:55.418192    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:56.196741 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:56.196704    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:56.918160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:56.918037    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:57.733131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:57.733094    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:58.493514 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:58.493468    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:59.322440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:22:59.322390    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:22:59.572806 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:22:59.572716    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:23:00.097010 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:00.096973    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:00.903837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:00.903786    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:01.683003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:01.682958    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:02.470876 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:02.470841    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:03.235917 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:03.235883    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:03.995323 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:03.995282    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:04.865781 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:04.865746    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:05.599680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:05.599647    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:06.296299 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:06.296255    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:06.533557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:06.533519    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:07.404879 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:07.404839    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:08.320632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:08.318148    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:09.279850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:09.279813    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:10.185928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:10.185888    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:10.982262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:10.982214    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:11.334713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:11.334592    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:11.883043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:11.883003    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:12.712970 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:12.712936    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:13.245802 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:13.245753    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:13.489536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:13.489495    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:14.308304 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:14.308261    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:15.086425 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:15.086378    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:15.842324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:15.842285    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:16.604791 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:16.604749    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:16.738513 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:16.738464    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:17.319247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:17.319206    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:17.839392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:17.839358    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:23:17.839662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:17.839633    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" podUID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" containerName="maas-api" containerID="cri-o://a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905" gracePeriod=30
Oct 31 13:23:17.929183 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:17.929147    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:18.082257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.082220    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:18.213836 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.213792    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:18.299061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.299033    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:23:18.400443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.400346    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") pod \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") "
Oct 31 13:23:18.400443 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.400409    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\") pod \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") "
Oct 31 13:23:18.400978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.400456    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\") pod \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") "
Oct 31 13:23:18.400978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.400547    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\" (UniqueName: \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\") pod \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\" (UID: \"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94\") "
Oct 31 13:23:18.400978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.400890    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca" pod "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" (UID: "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:23:18.401134 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.401041    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:18.402882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.402848    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls" pod "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" (UID: "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:23:18.403043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.402983    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn" pod "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" (UID: "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94"). InnerVolumeSpecName "kube-api-access-rbnbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:23:18.403043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.402989    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs" pod "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" (UID: "fe5ddb14-d160-4123-b6c3-c3c1bdfcec94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:23:18.502006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.501971    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbnbn\" (UniqueName: \"kubernetes.io/projected/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-kube-api-access-rbnbn\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:18.502006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.502004    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:18.502006 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.502015    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:18.645420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.645382    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:18.653341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.653222    4958 generic.go:356] "Generic (PLEG): container finished" podID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" containerID="a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905" exitCode=0
Oct 31 13:23:18.653341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.653315    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"
Oct 31 13:23:18.653341 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.653325    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" event={"ID":"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94","Type":"ContainerDied","Data":"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"}
Oct 31 13:23:18.653627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.653396    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc" event={"ID":"fe5ddb14-d160-4123-b6c3-c3c1bdfcec94","Type":"ContainerDied","Data":"183235550a4c3b315f577bed93dc27907c6ec84796be7d013a918cfcbb8fac2d"}
Oct 31 13:23:18.653627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.653426    4958 scope.go:122] "RemoveContainer" containerID="a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"
Oct 31 13:23:18.663870 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.663844    4958 scope.go:122] "RemoveContainer" containerID="a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"
Oct 31 13:23:18.664173 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:23:18.664147    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905\": container with ID starting with a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905 not found: ID does not exist" containerID="a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"
Oct 31 13:23:18.664242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.664183    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905"} err="failed to get container status \"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905\": rpc error: code = NotFound desc = could not find container \"a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905\": container with ID starting with a0fc1ad9d45695bbea79cc8896e6f0017532563fdc707d5d2355aa7ec72c9905 not found: ID does not exist"
Oct 31 13:23:18.673558 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.673534    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:23:18.678423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:18.678400    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-25d309-674978bf69-448dc"]
Oct 31 13:23:20.490319 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:20.490284    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" path="/var/lib/kubelet/pods/fe5ddb14-d160-4123-b6c3-c3c1bdfcec94/volumes"
Oct 31 13:23:24.891532 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:24.891497    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:25.031853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:25.031813    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:25.257712 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:25.257668    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:26.466794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.466745    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"]
Oct 31 13:23:26.472428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.472399    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-qt4vl"]
Oct 31 13:23:26.491792 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.491751    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f64660f-45d1-4420-8c6b-44bc5cbb2e40" path="/var/lib/kubelet/pods/4f64660f-45d1-4420-8c6b-44bc5cbb2e40/volumes"
Oct 31 13:23:26.495438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.495409    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"]
Oct 31 13:23:26.495869 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.495854    4958 cpu_manager.go:414] "containerMap: removing container" podUID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" containerName="maas-api"
Oct 31 13:23:26.495869 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.495868    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" containerName="maas-api"
Oct 31 13:23:26.496016 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.495957    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="fe5ddb14-d160-4123-b6c3-c3c1bdfcec94" containerName="maas-api"
Oct 31 13:23:26.500740 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.500717    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.509964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.509940    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"]
Oct 31 13:23:26.567882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.567833    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:23:26.568077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.567955    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:23:26.586679 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.586601    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.586890 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.586865    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7f4s\" (UniqueName: \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.587000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.586960    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.687962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.687926    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7f4s\" (UniqueName: \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.687962 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.687977    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.688223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.688065    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.688720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.688691    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.690499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.690459    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.701157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.701127    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7f4s\" (UniqueName: \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\") pod \"maas-api-revoke-sub-3d4156f1-t8724\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:26.816166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:26.816086    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:27.108785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:27.108756    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"]
Oct 31 13:23:27.111671 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:23:27.111634    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39e6584_7ee1_4781_b102_20ffc85fda58.slice/crio-f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa WatchSource:0}: Error finding container f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa: Status 404 returned error can't find the container with id f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa
Oct 31 13:23:27.714198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:27.714161    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724" event={"ID":"a39e6584-7ee1-4781-b102-20ffc85fda58","Type":"ContainerStarted","Data":"4cc3943153331a7dc3c28500c6856c0e7ab045e8d02c37330b3ed2faff61774e"}
Oct 31 13:23:27.714627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:27.714215    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724" event={"ID":"a39e6584-7ee1-4781-b102-20ffc85fda58","Type":"ContainerStarted","Data":"f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa"}
Oct 31 13:23:27.734635 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:27.734568    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724" podStartSLOduration=1.7345531950000002 podStartE2EDuration="1.734553195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:23:27.732777765 +0000 UTC m=+1429.396203451" watchObservedRunningTime="2026-10-31 13:23:27.734553195 +0000 UTC m=+1429.397978876"
Oct 31 13:23:28.721154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:28.721109    4958 generic.go:356] "Generic (PLEG): container finished" podID="a39e6584-7ee1-4781-b102-20ffc85fda58" containerID="4cc3943153331a7dc3c28500c6856c0e7ab045e8d02c37330b3ed2faff61774e" exitCode=0
Oct 31 13:23:28.721658 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:28.721188    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724" event={"ID":"a39e6584-7ee1-4781-b102-20ffc85fda58","Type":"ContainerDied","Data":"4cc3943153331a7dc3c28500c6856c0e7ab045e8d02c37330b3ed2faff61774e"}
Oct 31 13:23:29.572963 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:23:29.572925    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:23:29.874120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:29.874091    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:29.882666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:29.882639    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:30.027734 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.027695    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\" (UniqueName: \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\") pod \"a39e6584-7ee1-4781-b102-20ffc85fda58\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") "
Oct 31 13:23:30.027896 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.027803    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\") pod \"a39e6584-7ee1-4781-b102-20ffc85fda58\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") "
Oct 31 13:23:30.027896 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.027844    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\") pod \"a39e6584-7ee1-4781-b102-20ffc85fda58\" (UID: \"a39e6584-7ee1-4781-b102-20ffc85fda58\") "
Oct 31 13:23:30.028219 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.028194    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca" pod "a39e6584-7ee1-4781-b102-20ffc85fda58" (UID: "a39e6584-7ee1-4781-b102-20ffc85fda58"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:23:30.029991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.029967    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca" pod "a39e6584-7ee1-4781-b102-20ffc85fda58" (UID: "a39e6584-7ee1-4781-b102-20ffc85fda58"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:23:30.030106 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.030084    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s" pod "a39e6584-7ee1-4781-b102-20ffc85fda58" (UID: "a39e6584-7ee1-4781-b102-20ffc85fda58"). InnerVolumeSpecName "kube-api-access-h7f4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:23:30.128900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.128794    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7f4s\" (UniqueName: \"kubernetes.io/projected/a39e6584-7ee1-4781-b102-20ffc85fda58-kube-api-access-h7f4s\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:30.128900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.128848    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:30.128900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.128859    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a39e6584-7ee1-4781-b102-20ffc85fda58-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:30.735732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.735697    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"
Oct 31 13:23:30.735905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.735725    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724" event={"ID":"a39e6584-7ee1-4781-b102-20ffc85fda58","Type":"ContainerDied","Data":"f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa"}
Oct 31 13:23:30.735905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:30.735788    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8ea79b12c70bd24424fd27b72c1b58be62c1fecfa460e99fbec8e535bdecefa"
Oct 31 13:23:46.706215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:46.706177    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:48.350368 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.350329    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:48.418775 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.418730    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:23:48.419069 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.419019    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" podUID="83429353-c71a-4c25-9dac-3386c0f673a5" containerName="manager" containerID="cri-o://2d6cce31e71fcf8c46121c332795402803bcef6e1975445c74b83b2ad7834f46" gracePeriod=10
Oct 31 13:23:48.874833 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.874800    4958 generic.go:356] "Generic (PLEG): container finished" podID="83429353-c71a-4c25-9dac-3386c0f673a5" containerID="2d6cce31e71fcf8c46121c332795402803bcef6e1975445c74b83b2ad7834f46" exitCode=0
Oct 31 13:23:48.874992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.874860    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" event={"ID":"83429353-c71a-4c25-9dac-3386c0f673a5","Type":"ContainerDied","Data":"2d6cce31e71fcf8c46121c332795402803bcef6e1975445c74b83b2ad7834f46"}
Oct 31 13:23:48.893701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.893673    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:23:48.979964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.979915    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\") pod \"83429353-c71a-4c25-9dac-3386c0f673a5\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") "
Oct 31 13:23:48.980189 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.980110    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\" (UniqueName: \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\") pod \"83429353-c71a-4c25-9dac-3386c0f673a5\" (UID: \"83429353-c71a-4c25-9dac-3386c0f673a5\") "
Oct 31 13:23:48.980467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.980408    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume" pod "83429353-c71a-4c25-9dac-3386c0f673a5" (UID: "83429353-c71a-4c25-9dac-3386c0f673a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 13:23:48.980598 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.980534    4958 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/83429353-c71a-4c25-9dac-3386c0f673a5-extensions-socket-volume\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:48.982536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:48.982511    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5" pod "83429353-c71a-4c25-9dac-3386c0f673a5" (UID: "83429353-c71a-4c25-9dac-3386c0f673a5"). InnerVolumeSpecName "kube-api-access-zhqv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:23:49.008800 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.008767    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:49.081912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.081877    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhqv5\" (UniqueName: \"kubernetes.io/projected/83429353-c71a-4c25-9dac-3386c0f673a5-kube-api-access-zhqv5\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:23:49.882150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.882121    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"
Oct 31 13:23:49.882150 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.882133    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr" event={"ID":"83429353-c71a-4c25-9dac-3386c0f673a5","Type":"ContainerDied","Data":"273c64e4aac42f9135723557a83c55308d3576648d461dc0dfcce677e07c65a5"}
Oct 31 13:23:49.882694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.882224    4958 scope.go:122] "RemoveContainer" containerID="2d6cce31e71fcf8c46121c332795402803bcef6e1975445c74b83b2ad7834f46"
Oct 31 13:23:49.909553 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.909521    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:23:49.913684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:49.913656    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-c52mr"]
Oct 31 13:23:50.490764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:50.490732    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83429353-c71a-4c25-9dac-3386c0f673a5" path="/var/lib/kubelet/pods/83429353-c71a-4c25-9dac-3386c0f673a5/volumes"
Oct 31 13:23:51.851648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:51.851594    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:55.136395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:23:55.136363    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:23:59.572584 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:23:59.572549    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:24:22.792623 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:22.792524    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:24:22.926422 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:22.926380    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:24:28.857993 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:28.857946    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:24:29.572559 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:24:29.572518    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:24:29.932569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:29.932476    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:24:40.214867 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:40.214839    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:24:40.221490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:40.221469    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:24:40.355529 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:40.355503    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:24:40.362629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:40.362581    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:24:49.495519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.495478    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"]
Oct 31 13:24:49.496156 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496134    4958 cpu_manager.go:414] "containerMap: removing container" podUID="83429353-c71a-4c25-9dac-3386c0f673a5" containerName="manager"
Oct 31 13:24:49.496200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496159    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83429353-c71a-4c25-9dac-3386c0f673a5" containerName="manager"
Oct 31 13:24:49.496200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496177    4958 cpu_manager.go:414] "containerMap: removing container" podUID="a39e6584-7ee1-4781-b102-20ffc85fda58" containerName="revoke-keys"
Oct 31 13:24:49.496200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496183    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a39e6584-7ee1-4781-b102-20ffc85fda58" containerName="revoke-keys"
Oct 31 13:24:49.496306 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496296    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="83429353-c71a-4c25-9dac-3386c0f673a5" containerName="manager"
Oct 31 13:24:49.496340 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.496309    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="a39e6584-7ee1-4781-b102-20ffc85fda58" containerName="revoke-keys"
Oct 31 13:24:49.500718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.500701    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.505242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.505217    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-62gxj\""
Oct 31 13:24:49.515223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.515185    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"]
Oct 31 13:24:49.589660 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.589573    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9377bae1-10ee-4e39-a987-b64fef0334ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.589861 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.589722    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26f94\" (UniqueName: \"kubernetes.io/projected/9377bae1-10ee-4e39-a987-b64fef0334ce-kube-api-access-26f94\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.691149 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.691089    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9377bae1-10ee-4e39-a987-b64fef0334ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.691149 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.691160    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26f94\" (UniqueName: \"kubernetes.io/projected/9377bae1-10ee-4e39-a987-b64fef0334ce-kube-api-access-26f94\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.691590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.691567    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9377bae1-10ee-4e39-a987-b64fef0334ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.704795 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.704763    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26f94\" (UniqueName: \"kubernetes.io/projected/9377bae1-10ee-4e39-a987-b64fef0334ce-kube-api-access-26f94\") pod \"kuadrant-operator-controller-manager-678d87766f-twjxs\" (UID: \"9377bae1-10ee-4e39-a987-b64fef0334ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:49.822185 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:49.822096    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:50.106767 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:50.106736    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"]
Oct 31 13:24:50.107926 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:24:50.107901    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9377bae1_10ee_4e39_a987_b64fef0334ce.slice/crio-703f9ead25dc9aaa59e5f0972fb86c1a56536d85333be71beac703d05b5830c6 WatchSource:0}: Error finding container 703f9ead25dc9aaa59e5f0972fb86c1a56536d85333be71beac703d05b5830c6: Status 404 returned error can't find the container with id 703f9ead25dc9aaa59e5f0972fb86c1a56536d85333be71beac703d05b5830c6
Oct 31 13:24:50.236125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:50.236087    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs" event={"ID":"9377bae1-10ee-4e39-a987-b64fef0334ce","Type":"ContainerStarted","Data":"a5d5f8d17a17dc5c95f56c209901ee8a5aa7443bf3a400b4c7970c37744de4d2"}
Oct 31 13:24:50.236274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:50.236148    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs" event={"ID":"9377bae1-10ee-4e39-a987-b64fef0334ce","Type":"ContainerStarted","Data":"703f9ead25dc9aaa59e5f0972fb86c1a56536d85333be71beac703d05b5830c6"}
Oct 31 13:24:50.236274 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:50.236174    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:24:50.284393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:24:50.284307    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs" podStartSLOduration=1.284288077 podStartE2EDuration="1.284288077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:24:50.282434944 +0000 UTC m=+1511.945860647" watchObservedRunningTime="2026-10-31 13:24:50.284288077 +0000 UTC m=+1511.947713763"
Oct 31 13:24:59.577539 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:24:59.577490    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:25:01.244619 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:01.244581    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-twjxs"
Oct 31 13:25:12.581946 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.581905    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"]
Oct 31 13:25:12.585535 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.585511    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.597320 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.597290    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"]
Oct 31 13:25:12.624194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.624163    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:25:12.624469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.624450    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:25:12.628994 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.628963    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgwj\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.629120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.629035    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.629172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.629108    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.730837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.730790    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgwj\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.731050 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.730855    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.731050 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.730883    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.731554 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.731525    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.733392 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.733360    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.746408 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.746375    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgwj\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\") pod \"maas-api-revoke-sub-d576e68b-526tq\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:12.900499 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:12.900417    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:13.180919 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:13.180891    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"]
Oct 31 13:25:13.182985 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:25:13.182955    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec85c2c_d76f_45a7_a92f_94ffea7ef23e.slice/crio-d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034 WatchSource:0}: Error finding container d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034: Status 404 returned error can't find the container with id d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034
Oct 31 13:25:13.397590 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:13.397552    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq" event={"ID":"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e","Type":"ContainerStarted","Data":"d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034"}
Oct 31 13:25:14.405380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:14.405344    4958 generic.go:356] "Generic (PLEG): container finished" podID="7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" containerID="65986e7c1452fc2c2195cb25417c787660d29b12c131177f4770fe56b46c4bb9" exitCode=0
Oct 31 13:25:14.405800 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:14.405435    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq" event={"ID":"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e","Type":"ContainerDied","Data":"65986e7c1452fc2c2195cb25417c787660d29b12c131177f4770fe56b46c4bb9"}
Oct 31 13:25:15.548343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.548305    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:15.660362 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.660324    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\") pod \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") "
Oct 31 13:25:15.660534 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.660483    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\") pod \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") "
Oct 31 13:25:15.660643 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.660594    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\") pod \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\" (UID: \"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e\") "
Oct 31 13:25:15.660916 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.660889    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca" pod "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" (UID: "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:25:15.662666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.662581    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca" pod "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" (UID: "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:25:15.662772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.662691    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj" pod "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" (UID: "7ec85c2c-d76f-45a7-a92f-94ffea7ef23e"). InnerVolumeSpecName "kube-api-access-rmgwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:25:15.761990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.761950    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:15.761990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.761984    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:15.761990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:15.761995    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmgwj\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e-kube-api-access-rmgwj\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:16.417981 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:16.417950    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"
Oct 31 13:25:16.418159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:16.417981    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq" event={"ID":"7ec85c2c-d76f-45a7-a92f-94ffea7ef23e","Type":"ContainerDied","Data":"d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034"}
Oct 31 13:25:16.418159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:16.418024    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3a65cd1ab8796e50a51cb7c05ce09a41ecfd131912bfdff3a7543f0041f6034"
Oct 31 13:25:29.574901 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:25:29.574851    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:25:30.003246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:30.003205    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:31.601860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.601823    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"]
Oct 31 13:25:31.602506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.602484    4958 cpu_manager.go:414] "containerMap: removing container" podUID="7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" containerName="revoke-keys"
Oct 31 13:25:31.602596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.602509    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" containerName="revoke-keys"
Oct 31 13:25:31.602694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.602681    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" containerName="revoke-keys"
Oct 31 13:25:31.606034 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.606009    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.614200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.614172    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:25:31.614339 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.614257    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:25:31.617420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.617389    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"]
Oct 31 13:25:31.649872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.649828    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9lqz\" (UniqueName: \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.650074 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.649881    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.650074 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.650052    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.751166 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.751119    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.751380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.751205    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9lqz\" (UniqueName: \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.751380 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.751229    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.751886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.751861    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.753763 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.753733    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.764873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.764847    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9lqz\" (UniqueName: \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\") pod \"maas-api-revoke-sub-d2bc93bc-7ztkc\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:31.922629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:31.922516    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:32.214059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:32.214020    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"]
Oct 31 13:25:32.215567 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:25:32.215540    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06749221_ac0d_4f90_8f6c_0b2c88bd2cb1.slice/crio-4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7 WatchSource:0}: Error finding container 4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7: Status 404 returned error can't find the container with id 4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7
Oct 31 13:25:32.526364 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:32.526331    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc" event={"ID":"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1","Type":"ContainerStarted","Data":"4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7"}
Oct 31 13:25:33.533684 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:33.533630    4958 generic.go:356] "Generic (PLEG): container finished" podID="06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" containerID="94d21e9e9d25cd6f589d10c83693752f07861ce90cb263976f8a6d6a50387340" exitCode=0
Oct 31 13:25:33.534105 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:33.533715    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc" event={"ID":"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1","Type":"ContainerDied","Data":"94d21e9e9d25cd6f589d10c83693752f07861ce90cb263976f8a6d6a50387340"}
Oct 31 13:25:34.679370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.679332    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:34.780878 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.780844    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\" (UniqueName: \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\") pod \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") "
Oct 31 13:25:34.781081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.780904    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\") pod \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") "
Oct 31 13:25:34.781081 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.781060    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\") pod \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\" (UID: \"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1\") "
Oct 31 13:25:34.781465 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.781441    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca" pod "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" (UID: "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:25:34.783239 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.783215    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz" pod "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" (UID: "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1"). InnerVolumeSpecName "kube-api-access-n9lqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:25:34.783335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.783237    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca" pod "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" (UID: "06749221-ac0d-4f90-8f6c-0b2c88bd2cb1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:25:34.882162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.882075    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:34.882162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.882107    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9lqz\" (UniqueName: \"kubernetes.io/projected/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-kube-api-access-n9lqz\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:34.882162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:34.882117    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:25:35.546177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:35.546142    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"
Oct 31 13:25:35.546177 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:35.546168    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc" event={"ID":"06749221-ac0d-4f90-8f6c-0b2c88bd2cb1","Type":"ContainerDied","Data":"4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7"}
Oct 31 13:25:35.546421 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:35.546222    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c42c07bd7170ef86e6c47aef724c15e2ecc4ba219659e6ab2b65b59100fedb7"
Oct 31 13:25:43.224903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:43.224856    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:43.733260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:43.733204    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:43.867498 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:43.867466    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:47.225778 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:47.225692    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:47.408205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:47.408173    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:48.395031 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.394992    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:25:48.395761 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.395738    4958 cpu_manager.go:414] "containerMap: removing container" podUID="06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" containerName="revoke-keys"
Oct 31 13:25:48.395821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.395765    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" containerName="revoke-keys"
Oct 31 13:25:48.395913 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.395900    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" containerName="revoke-keys"
Oct 31 13:25:48.400766 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.400744    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.410978 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.410948    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2hbvg\""
Oct 31 13:25:48.411276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.411253    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 13:25:48.411426 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.411269    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-2c64dd-serving-cert\""
Oct 31 13:25:48.411976 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.411926    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:25:48.468751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.468707    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:48.513561 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.513528    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.513759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.513586    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.513759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.513701    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274k8\" (UniqueName: \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.513830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.513791    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.614427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.614380    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.614675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.614472    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-274k8\" (UniqueName: \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.614675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.614554    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.614675 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.614635    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.619054 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.619027    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.625247 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.625181    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:48.634872 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.634044    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.636843 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.636775    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-274k8\" (UniqueName: \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.640900 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.640865    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:48.720060 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:48.720025    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:49.004329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.004303    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:25:49.005872 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:25:49.005834    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101ad6d9_62a6_4e94_aa8a_3a5e21e5cf55.slice/crio-9e51294467bd6005e34586102adea31e2d5fffa822498ee11ed7153592128766 WatchSource:0}: Error finding container 9e51294467bd6005e34586102adea31e2d5fffa822498ee11ed7153592128766: Status 404 returned error can't find the container with id 9e51294467bd6005e34586102adea31e2d5fffa822498ee11ed7153592128766
Oct 31 13:25:49.588310 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.588224    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:49.645095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.645002    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" event={"ID":"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55","Type":"ContainerStarted","Data":"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"}
Oct 31 13:25:49.645095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.645055    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" event={"ID":"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55","Type":"ContainerStarted","Data":"9e51294467bd6005e34586102adea31e2d5fffa822498ee11ed7153592128766"}
Oct 31 13:25:49.645329 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.645137    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:49.670007 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:49.669954    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" podStartSLOduration=1.2903169380000001 podStartE2EDuration="1.669940881s" totalImagesPullingTime="379.623943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:25:49.667482321 +0000 UTC m=+1571.330908004" watchObservedRunningTime="2026-10-31 13:25:49.669940881 +0000 UTC m=+1571.333366565"
Oct 31 13:25:50.397515 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:50.397483    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:51.142683 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:51.142623    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:52.181157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:52.181115    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:52.889950 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:52.889904    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:53.712073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:53.712034    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:54.507163 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:54.507128    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:55.311815 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:55.311764    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:55.656481 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:55.656393    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:25:56.430061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:56.430029    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:57.036347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:57.036310    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:57.208596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:57.208555    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:57.657111 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:57.657070    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:57.791587 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:57.791557    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:57.947630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:57.947505    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:58.125445 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:58.125375    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:59.012439 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:59.012401    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:25:59.574807 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:25:59.574770    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:25:59.893273 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:25:59.893175    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:00.693317 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:00.693285    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:00.828495 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:00.828453    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:01.495903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:01.495864    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:02.473447 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:02.470934    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:03.492519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:03.492482    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:04.355127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:04.355094    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:04.996836 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:04.996799    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:05.800350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:05.800293    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:06.584925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:06.584895    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:07.472154 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:07.472105    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:08.195927 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:08.195884    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:08.999206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:08.999164    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:09.787411 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:09.787370    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:10.587036 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:10.586994    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:11.378702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:11.378667    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:12.182555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:12.182514    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:12.996925 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:12.996875    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:13.797092 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:13.797055    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:14.499059 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:14.499023    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:15.390963 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:15.390921    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:16.201548 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:16.201509    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:17.183370 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:17.183334    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:17.997506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:17.997467    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:18.821742 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:18.821693    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:19.595413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:19.595377    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:20.408003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:20.407959    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:21.191918 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:21.191879    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:21.984260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:21.984220    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:22.700079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:22.700044    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:23.635136 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:23.635099    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:24.394198 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:24.394159    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:25.292987 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:25.292929    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:26.196393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:26.196350    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:27.002396 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:27.002350    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:27.715564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:27.715522    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:28.498316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:28.498278    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:29.290214 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:29.290156    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:29.575160 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:26:29.575072    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:26:30.040621 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:30.040567    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:30.178146 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:30.178103    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:31.114580 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:31.114546    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:32.017911 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:32.017874    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:32.816567 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:32.816531    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:33.601723 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:33.601670    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:34.411898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:34.411859    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:35.152200 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:35.152159    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:36.253477 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:36.253438    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:36.902597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:36.902556    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:37.701634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:37.701565    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:38.515157 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:38.515119    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:39.292438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:39.291939    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:40.049235 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:40.049197    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:40.230551 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:40.230508    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:41.190174 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:41.190131    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:42.108814 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:42.108767    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:42.892537 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:42.892494    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:43.684184 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:43.684130    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:44.483554 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:44.483506    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:45.168627 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:45.168577    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:45.388737 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:45.388700    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:46.185058 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:46.185025    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:46.991194 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:46.991163    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:47.693955 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:47.693902    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:48.484487 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:48.484447    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:49.300172 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:49.300120    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:50.185574 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:50.185543    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:50.445971 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:50.445878    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:50.619976 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:50.619936    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:50.912428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:50.912394    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:51.473893 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.473848    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:26:51.474506 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.474082    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" podUID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" containerName="maas-api" containerID="cri-o://7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8" gracePeriod=30
Oct 31 13:26:51.560395 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.560354    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:51.729779 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.729595    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:51.778466 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.778424    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:26:51.785986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.785934    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\") pod \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") "
Oct 31 13:26:51.786143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.786023    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\") pod \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") "
Oct 31 13:26:51.786226 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.786154    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\" (UniqueName: \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\") pod \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") "
Oct 31 13:26:51.786226 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.786209    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\") pod \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\" (UID: \"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55\") "
Oct 31 13:26:51.788425 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.788388    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca" pod "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" (UID: "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:26:51.790780 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.790728    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls" pod "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" (UID: "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:26:51.790942 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.790820    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs" pod "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" (UID: "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:26:51.792033 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.791996    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8" pod "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" (UID: "101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55"). InnerVolumeSpecName "kube-api-access-274k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:26:51.859855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.859797    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:51.888801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.888756    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:26:51.888801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.888796    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:26:51.888801 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.888808    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-274k8\" (UniqueName: \"kubernetes.io/projected/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-kube-api-access-274k8\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:26:51.889093 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:51.888818    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:26:52.062824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.062712    4958 generic.go:356] "Generic (PLEG): container finished" podID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" containerID="7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8" exitCode=0
Oct 31 13:26:52.062824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.062768    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"
Oct 31 13:26:52.062824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.062810    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" event={"ID":"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55","Type":"ContainerDied","Data":"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"}
Oct 31 13:26:52.063138 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.062865    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr" event={"ID":"101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55","Type":"ContainerDied","Data":"9e51294467bd6005e34586102adea31e2d5fffa822498ee11ed7153592128766"}
Oct 31 13:26:52.063138 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.062889    4958 scope.go:122] "RemoveContainer" containerID="7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"
Oct 31 13:26:52.075241 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.075217    4958 scope.go:122] "RemoveContainer" containerID="7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"
Oct 31 13:26:52.075598 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:26:52.075575    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8\": container with ID starting with 7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8 not found: ID does not exist" containerID="7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"
Oct 31 13:26:52.075701 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.075638    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8"} err="failed to get container status \"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8\": rpc error: code = NotFound desc = could not find container \"7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8\": container with ID starting with 7d8ea4b42665de3fb84b56a05c00729f1a165d384c4a102c8c5d708cded4dca8 not found: ID does not exist"
Oct 31 13:26:52.090105 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.090071    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:26:52.094960 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.094925    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c64dd-86d5cd5575-5p9tr"]
Oct 31 13:26:52.304992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.304956    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:52.492257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:52.492225    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" path="/var/lib/kubelet/pods/101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55/volumes"
Oct 31 13:26:59.133318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:59.133282    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:59.269456 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:59.269400    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:59.492704 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:26:59.492563    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:26:59.594130 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:26:59.594090    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:27:04.060772 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:04.060733    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:04.256095 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:04.256055    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:08.729267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:08.728748    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:27:08.729267 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:08.728822    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:27:22.440268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:22.440057    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:22.981295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:22.981247    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:26.250529 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:26.250489    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:29.475874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:29.475828    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:29.589771 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:27:29.589725    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:27:30.233634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:30.226275    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:27:42.399984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.399949    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"]
Oct 31 13:27:42.400418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.400405    4958 cpu_manager.go:414] "containerMap: removing container" podUID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" containerName="maas-api"
Oct 31 13:27:42.400418 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.400418    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" containerName="maas-api"
Oct 31 13:27:42.400519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.400510    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="101ad6d9-62a6-4e94-aa8a-3a5e21e5cf55" containerName="maas-api"
Oct 31 13:27:42.404895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.404877    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.411196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.411169    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:27:42.411470 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.411443    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:27:42.413838 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.413815    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"]
Oct 31 13:27:42.504516 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.504479    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7c8s\" (UniqueName: \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.504738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.504524    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.504738 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.504549    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.605908 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.605867    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7c8s\" (UniqueName: \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.606131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.605987    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.606131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.606014    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.606745 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.606720    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.608512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.608488    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.619138 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.619114    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7c8s\" (UniqueName: \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\") pod \"maas-api-revoke-sub-452b6d7b-5t7xs\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:42.720428 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:42.720391    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:43.001619 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:43.001567    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"]
Oct 31 13:27:43.002429 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:27:43.002399    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99bab5f_dc7f_4b6e_aaff_0916b105b47d.slice/crio-8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b WatchSource:0}: Error finding container 8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b: Status 404 returned error can't find the container with id 8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b
Oct 31 13:27:43.455023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:43.454976    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs" event={"ID":"b99bab5f-dc7f-4b6e-aaff-0916b105b47d","Type":"ContainerStarted","Data":"ed7097cf9724339fde434ef77ed62aa58c77579e2f515c794d46e77a1ef78540"}
Oct 31 13:27:43.455544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:43.455058    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs" event={"ID":"b99bab5f-dc7f-4b6e-aaff-0916b105b47d","Type":"ContainerStarted","Data":"8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b"}
Oct 31 13:27:43.476115 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:43.476068    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs" podStartSLOduration=1.476052027 podStartE2EDuration="1.476052027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:27:43.474480719 +0000 UTC m=+1685.137906422" watchObservedRunningTime="2026-10-31 13:27:43.476052027 +0000 UTC m=+1685.139477712"
Oct 31 13:27:44.466518 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:44.466473    4958 generic.go:356] "Generic (PLEG): container finished" podID="b99bab5f-dc7f-4b6e-aaff-0916b105b47d" containerID="ed7097cf9724339fde434ef77ed62aa58c77579e2f515c794d46e77a1ef78540" exitCode=0
Oct 31 13:27:44.467108 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:44.466548    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs" event={"ID":"b99bab5f-dc7f-4b6e-aaff-0916b105b47d","Type":"ContainerDied","Data":"ed7097cf9724339fde434ef77ed62aa58c77579e2f515c794d46e77a1ef78540"}
Oct 31 13:27:46.014979 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.014622    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:46.150343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.146754    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\") pod \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") "
Oct 31 13:27:46.150343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.147329    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\" (UniqueName: \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\") pod \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") "
Oct 31 13:27:46.150343 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.147534    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\") pod \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\" (UID: \"b99bab5f-dc7f-4b6e-aaff-0916b105b47d\") "
Oct 31 13:27:46.164916 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.150750    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca" pod "b99bab5f-dc7f-4b6e-aaff-0916b105b47d" (UID: "b99bab5f-dc7f-4b6e-aaff-0916b105b47d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:27:46.193696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.160046    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:27:46.205676 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.204817    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s" pod "b99bab5f-dc7f-4b6e-aaff-0916b105b47d" (UID: "b99bab5f-dc7f-4b6e-aaff-0916b105b47d"). InnerVolumeSpecName "kube-api-access-g7c8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:27:46.209161 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.209124    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca" pod "b99bab5f-dc7f-4b6e-aaff-0916b105b47d" (UID: "b99bab5f-dc7f-4b6e-aaff-0916b105b47d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:27:46.284442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.284303    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:27:46.284442 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.284384    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7c8s\" (UniqueName: \"kubernetes.io/projected/b99bab5f-dc7f-4b6e-aaff-0916b105b47d-kube-api-access-g7c8s\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:27:46.501545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.501502    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs" event={"ID":"b99bab5f-dc7f-4b6e-aaff-0916b105b47d","Type":"ContainerDied","Data":"8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b"}
Oct 31 13:27:46.501545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.501540    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"
Oct 31 13:27:46.501805 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:27:46.501563    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f6050c0a679659bd986261d59017c5d4e65b6fc2a56a47d2d6d0763cce2016b"
Oct 31 13:27:59.572740 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:27:59.572700    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:28:03.442045 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:03.442006    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:05.151064 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:05.151024    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:08.599626 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.599563    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"]
Oct 31 13:28:08.608633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.600304    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b99bab5f-dc7f-4b6e-aaff-0916b105b47d" containerName="revoke-keys"
Oct 31 13:28:08.608633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.600329    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b99bab5f-dc7f-4b6e-aaff-0916b105b47d" containerName="revoke-keys"
Oct 31 13:28:08.608633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.600477    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="b99bab5f-dc7f-4b6e-aaff-0916b105b47d" containerName="revoke-keys"
Oct 31 13:28:08.616148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.614871    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"]
Oct 31 13:28:08.616148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.615010    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.664596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.663985    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:28:08.664596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.664063    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:28:08.696360 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.696318    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwflp\" (UniqueName: \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.696653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.696629    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.696980 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.696960    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.697450 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.697414    4958 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-ckhwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 13:28:08.697557 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.697475    4958 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-ckhwx" podUID="97ae0c6b-03b6-483f-b261-b292222e09a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 13:28:08.797938 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.797898    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.798160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.797955    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwflp\" (UniqueName: \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.798160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.797984    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.805651 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.798792    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.805651 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.801267    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:08.812638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:08.812586    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwflp\" (UniqueName: \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\") pod \"maas-api-revoke-sub-3e31a506-rsnzd\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:09.012435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:09.012353    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:09.325264 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:09.325207    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"]
Oct 31 13:28:09.704365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:09.701225    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd" event={"ID":"c008c89e-c443-418e-a1e0-e5a4c4c7975a","Type":"ContainerStarted","Data":"548af8da191656057335a3b7879c443e6820d8cff0768d52f08273e59bfda99b"}
Oct 31 13:28:09.704365 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:09.701307    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd" event={"ID":"c008c89e-c443-418e-a1e0-e5a4c4c7975a","Type":"ContainerStarted","Data":"1bd3b746727dc4e8e9660d9931efdd46ee60583c2adea86397568d936ccbf6ef"}
Oct 31 13:28:10.711572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:10.711525    4958 generic.go:356] "Generic (PLEG): container finished" podID="c008c89e-c443-418e-a1e0-e5a4c4c7975a" containerID="548af8da191656057335a3b7879c443e6820d8cff0768d52f08273e59bfda99b" exitCode=0
Oct 31 13:28:10.712071 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:10.711764    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd" event={"ID":"c008c89e-c443-418e-a1e0-e5a4c4c7975a","Type":"ContainerDied","Data":"548af8da191656057335a3b7879c443e6820d8cff0768d52f08273e59bfda99b"}
Oct 31 13:28:11.862384 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.862356    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:11.981342 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.981236    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\") pod \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") "
Oct 31 13:28:11.981519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.981364    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\" (UniqueName: \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\") pod \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") "
Oct 31 13:28:11.981519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.981429    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\") pod \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\" (UID: \"c008c89e-c443-418e-a1e0-e5a4c4c7975a\") "
Oct 31 13:28:11.981891 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.981865    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca" pod "c008c89e-c443-418e-a1e0-e5a4c4c7975a" (UID: "c008c89e-c443-418e-a1e0-e5a4c4c7975a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:28:11.983476 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.983446    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca" pod "c008c89e-c443-418e-a1e0-e5a4c4c7975a" (UID: "c008c89e-c443-418e-a1e0-e5a4c4c7975a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:28:11.983580 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:11.983568    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp" pod "c008c89e-c443-418e-a1e0-e5a4c4c7975a" (UID: "c008c89e-c443-418e-a1e0-e5a4c4c7975a"). InnerVolumeSpecName "kube-api-access-bwflp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:28:12.082882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.082815    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:12.082882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.082881    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwflp\" (UniqueName: \"kubernetes.io/projected/c008c89e-c443-418e-a1e0-e5a4c4c7975a-kube-api-access-bwflp\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:12.082882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.082900    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c008c89e-c443-418e-a1e0-e5a4c4c7975a-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:12.724859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.724824    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"
Oct 31 13:28:12.724859 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.724838    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd" event={"ID":"c008c89e-c443-418e-a1e0-e5a4c4c7975a","Type":"ContainerDied","Data":"1bd3b746727dc4e8e9660d9931efdd46ee60583c2adea86397568d936ccbf6ef"}
Oct 31 13:28:12.725079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:12.724884    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bd3b746727dc4e8e9660d9931efdd46ee60583c2adea86397568d936ccbf6ef"
Oct 31 13:28:20.095576 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:20.095528    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:20.238350 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:20.238312    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:29.007314 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.007272    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"]
Oct 31 13:28:29.007995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.007971    4958 cpu_manager.go:414] "containerMap: removing container" podUID="c008c89e-c443-418e-a1e0-e5a4c4c7975a" containerName="revoke-keys"
Oct 31 13:28:29.008107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.007996    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c008c89e-c443-418e-a1e0-e5a4c4c7975a" containerName="revoke-keys"
Oct 31 13:28:29.008107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.008103    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="c008c89e-c443-418e-a1e0-e5a4c4c7975a" containerName="revoke-keys"
Oct 31 13:28:29.011716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.011693    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.018929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.018899    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 13:28:29.019086 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.018959    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v9mdk\""
Oct 31 13:28:29.023018 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.022987    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"]
Oct 31 13:28:29.040390 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.040345    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfrq\" (UniqueName: \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.040552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.040480    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.040552 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.040543    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.141837 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.141796    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.142046 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.141903    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfrq\" (UniqueName: \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.142046 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.141955    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.142549 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.142521    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.144322 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.144301    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.154860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.154837    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfrq\" (UniqueName: \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\") pod \"maas-api-revoke-sub-c9f3f15c-m26ql\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.327544 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.327456    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:29.573285 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:28:29.573247    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:28:29.609560 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.607464    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"]
Oct 31 13:28:29.862205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:29.862120    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql" event={"ID":"e9bb9fb2-8f43-4a87-b46b-41448958c373","Type":"ContainerStarted","Data":"aeefd80b77063483658e5d2e18dfeef88769fdfdb1eccc7fa100491ecc7a09db"}
Oct 31 13:28:30.030457 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.030415    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"]
Oct 31 13:28:30.033854 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.033823    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-t8724"]
Oct 31 13:28:30.289020 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.288987    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:30.490944 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.490910    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a39e6584-7ee1-4781-b102-20ffc85fda58" path="/var/lib/kubelet/pods/a39e6584-7ee1-4781-b102-20ffc85fda58/volumes"
Oct 31 13:28:30.871839 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.871806    4958 generic.go:356] "Generic (PLEG): container finished" podID="e9bb9fb2-8f43-4a87-b46b-41448958c373" containerID="9276f1b29847460efd6284f158920a175ffb487559e35cef34ed3984cdebcda5" exitCode=0
Oct 31 13:28:30.872028 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:30.871882    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql" event={"ID":"e9bb9fb2-8f43-4a87-b46b-41448958c373","Type":"ContainerDied","Data":"9276f1b29847460efd6284f158920a175ffb487559e35cef34ed3984cdebcda5"}
Oct 31 13:28:32.021650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.021600    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:32.071848 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.071806    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\") pod \"e9bb9fb2-8f43-4a87-b46b-41448958c373\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") "
Oct 31 13:28:32.072060 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.071960    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\") pod \"e9bb9fb2-8f43-4a87-b46b-41448958c373\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") "
Oct 31 13:28:32.072060 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.072003    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\" (UniqueName: \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\") pod \"e9bb9fb2-8f43-4a87-b46b-41448958c373\" (UID: \"e9bb9fb2-8f43-4a87-b46b-41448958c373\") "
Oct 31 13:28:32.072254 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.072215    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca" pod "e9bb9fb2-8f43-4a87-b46b-41448958c373" (UID: "e9bb9fb2-8f43-4a87-b46b-41448958c373"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:28:32.074223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.074197    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca" pod "e9bb9fb2-8f43-4a87-b46b-41448958c373" (UID: "e9bb9fb2-8f43-4a87-b46b-41448958c373"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:28:32.074538 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.074521    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq" pod "e9bb9fb2-8f43-4a87-b46b-41448958c373" (UID: "e9bb9fb2-8f43-4a87-b46b-41448958c373"). InnerVolumeSpecName "kube-api-access-4pfrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:28:32.173427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.173334    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-xks-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:32.173427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.173374    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pfrq\" (UniqueName: \"kubernetes.io/projected/e9bb9fb2-8f43-4a87-b46b-41448958c373-kube-api-access-4pfrq\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:32.173427 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.173386    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb9fb2-8f43-4a87-b46b-41448958c373-maas-api-openshift-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:32.884502 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.884418    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"
Oct 31 13:28:32.884686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.884420    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql" event={"ID":"e9bb9fb2-8f43-4a87-b46b-41448958c373","Type":"ContainerDied","Data":"aeefd80b77063483658e5d2e18dfeef88769fdfdb1eccc7fa100491ecc7a09db"}
Oct 31 13:28:32.884686 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:32.884557    4958 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aeefd80b77063483658e5d2e18dfeef88769fdfdb1eccc7fa100491ecc7a09db"
Oct 31 13:28:39.479344 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:39.479308    4958 scope.go:122] "RemoveContainer" containerID="98b82a5303a5d4baae90af364747fc2a7845a77d955baabdc44623e245057679"
Oct 31 13:28:41.219295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.218855    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:41.219766 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.219597    4958 cpu_manager.go:414] "containerMap: removing container" podUID="e9bb9fb2-8f43-4a87-b46b-41448958c373" containerName="revoke-keys"
Oct 31 13:28:41.219766 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.219639    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9bb9fb2-8f43-4a87-b46b-41448958c373" containerName="revoke-keys"
Oct 31 13:28:41.219847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.219793    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9bb9fb2-8f43-4a87-b46b-41448958c373" containerName="revoke-keys"
Oct 31 13:28:41.224692 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.224665    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.237024 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.235854    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 13:28:41.237024 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.236075    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 13:28:41.237024 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.236162    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2hbvg\""
Oct 31 13:28:41.240512 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.239179    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:41.242787 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.242754    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"]
Oct 31 13:28:41.246995 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.246966    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.265818 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.265788    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"]
Oct 31 13:28:41.367460 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367426    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.367688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367492    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.367688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367600    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9sj\" (UniqueName: \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.367688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367652    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-metrics-certs\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.367688 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367672    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.367873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367772    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-openshift-service-ca\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.367873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367805    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5hlv\" (UniqueName: \"kubernetes.io/projected/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-kube-api-access-q5hlv\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.367873 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.367827    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-maas-api-tls\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.469089 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469041    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.469293 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469118    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9sj\" (UniqueName: \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.469293 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469145    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-metrics-certs\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.469293 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469165    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.469293 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469205    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-openshift-service-ca\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.469560 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469382    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5hlv\" (UniqueName: \"kubernetes.io/projected/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-kube-api-access-q5hlv\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.469560 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469418    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-maas-api-tls\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.469560 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.469483    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.470206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.470182    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.470335 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.470307    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-openshift-service-ca\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.471947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.471919    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.472063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.472003    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-maas-api-tls\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.472196 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.472175    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.472257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.472208    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-metrics-certs\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.484153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.484126    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9sj\" (UniqueName: \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\") pod \"maas-api-54d9cc59bd-g92rl\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") " pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.484420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.484396    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5hlv\" (UniqueName: \"kubernetes.io/projected/aa9aea0d-624f-4512-aaa3-5aa2dae8661c-kube-api-access-q5hlv\") pod \"maas-api-7df6dd5c76-hqqrs\" (UID: \"aa9aea0d-624f-4512-aaa3-5aa2dae8661c\") " pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.544967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.544925    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:41.571185 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.570639    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:41.834649 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.834595    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:41.836001 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:28:41.835965    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29fb81c_091f_4531_9c1d_9612ed0cc99f.slice/crio-d4670ca027d7a9df528cbaacb86191d541889b7b37598a92db60a2395e1e4c19 WatchSource:0}: Error finding container d4670ca027d7a9df528cbaacb86191d541889b7b37598a92db60a2395e1e4c19: Status 404 returned error can't find the container with id d4670ca027d7a9df528cbaacb86191d541889b7b37598a92db60a2395e1e4c19
Oct 31 13:28:41.837834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.837809    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:28:41.871569 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.871532    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"]
Oct 31 13:28:41.876175 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:28:41.876147    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9aea0d_624f_4512_aaa3_5aa2dae8661c.slice/crio-be1ca32cbd3df97c4c744e3a10e8d21f655e29ef32ce146c5b89ad5b0243fc01 WatchSource:0}: Error finding container be1ca32cbd3df97c4c744e3a10e8d21f655e29ef32ce146c5b89ad5b0243fc01: Status 404 returned error can't find the container with id be1ca32cbd3df97c4c744e3a10e8d21f655e29ef32ce146c5b89ad5b0243fc01
Oct 31 13:28:41.942467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.942419    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs" event={"ID":"aa9aea0d-624f-4512-aaa3-5aa2dae8661c","Type":"ContainerStarted","Data":"be1ca32cbd3df97c4c744e3a10e8d21f655e29ef32ce146c5b89ad5b0243fc01"}
Oct 31 13:28:41.943940 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:41.943907    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" event={"ID":"b29fb81c-091f-4531-9c1d-9612ed0cc99f","Type":"ContainerStarted","Data":"d4670ca027d7a9df528cbaacb86191d541889b7b37598a92db60a2395e1e4c19"}
Oct 31 13:28:42.952874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.952829    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" event={"ID":"b29fb81c-091f-4531-9c1d-9612ed0cc99f","Type":"ContainerStarted","Data":"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"}
Oct 31 13:28:42.953381 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.953059    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:42.955050 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.955021    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs" event={"ID":"aa9aea0d-624f-4512-aaa3-5aa2dae8661c","Type":"ContainerStarted","Data":"4eb2e4bc3ef087e8e2d8ceebf3316725397dbf4d14c82b7d833a2b8570b692aa"}
Oct 31 13:28:42.955635 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.955133    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:42.976715 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.976670    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" podStartSLOduration=1.404895859 podStartE2EDuration="1.976657973s" totalImagesPullingTime="571.762114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:28:42.973972799 +0000 UTC m=+1744.637398495" watchObservedRunningTime="2026-10-31 13:28:42.976657973 +0000 UTC m=+1744.640083657"
Oct 31 13:28:42.997424 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:42.997380    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs" podStartSLOduration=1.505197371 podStartE2EDuration="1.997368058s" totalImagesPullingTime="492.170687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:28:42.994689919 +0000 UTC m=+1744.658115603" watchObservedRunningTime="2026-10-31 13:28:42.997368058 +0000 UTC m=+1744.660793771"
Oct 31 13:28:48.213359 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:48.213321    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:48.936746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:48.936709    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:48.971349 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:48.971314    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7df6dd5c76-hqqrs"
Oct 31 13:28:48.971575 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:48.971559    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:49.074694 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.074644    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:49.074897 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.074854    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" podUID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" containerName="maas-api" containerID="cri-o://c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16" gracePeriod=30
Oct 31 13:28:49.115977 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.115937    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:49.347825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.347795    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:49.452354 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.452263    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\") pod \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") "
Oct 31 13:28:49.452508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.452353    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\") pod \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") "
Oct 31 13:28:49.452555 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.452526    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\") pod \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") "
Oct 31 13:28:49.452640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.452622    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\" (UniqueName: \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\") pod \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\" (UID: \"b29fb81c-091f-4531-9c1d-9612ed0cc99f\") "
Oct 31 13:28:49.452983 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.452953    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca" pod "b29fb81c-091f-4531-9c1d-9612ed0cc99f" (UID: "b29fb81c-091f-4531-9c1d-9612ed0cc99f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:28:49.453139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.453104    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29fb81c-091f-4531-9c1d-9612ed0cc99f-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:49.454765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.454736    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs" pod "b29fb81c-091f-4531-9c1d-9612ed0cc99f" (UID: "b29fb81c-091f-4531-9c1d-9612ed0cc99f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:28:49.455043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.455022    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls" pod "b29fb81c-091f-4531-9c1d-9612ed0cc99f" (UID: "b29fb81c-091f-4531-9c1d-9612ed0cc99f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:28:49.455167 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.455143    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj" pod "b29fb81c-091f-4531-9c1d-9612ed0cc99f" (UID: "b29fb81c-091f-4531-9c1d-9612ed0cc99f"). InnerVolumeSpecName "kube-api-access-zv9sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:28:49.554223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.554180    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv9sj\" (UniqueName: \"kubernetes.io/projected/b29fb81c-091f-4531-9c1d-9612ed0cc99f-kube-api-access-zv9sj\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:49.554223 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.554220    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:49.554440 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:49.554234    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29fb81c-091f-4531-9c1d-9612ed0cc99f-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:28:50.002316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.002232    4958 generic.go:356] "Generic (PLEG): container finished" podID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" containerID="c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16" exitCode=0
Oct 31 13:28:50.002316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.002292    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"
Oct 31 13:28:50.002508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.002321    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" event={"ID":"b29fb81c-091f-4531-9c1d-9612ed0cc99f","Type":"ContainerDied","Data":"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"}
Oct 31 13:28:50.002508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.002405    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl" event={"ID":"b29fb81c-091f-4531-9c1d-9612ed0cc99f","Type":"ContainerDied","Data":"d4670ca027d7a9df528cbaacb86191d541889b7b37598a92db60a2395e1e4c19"}
Oct 31 13:28:50.002508 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.002428    4958 scope.go:122] "RemoveContainer" containerID="c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"
Oct 31 13:28:50.013000 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.012980    4958 scope.go:122] "RemoveContainer" containerID="c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"
Oct 31 13:28:50.013270 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:28:50.013251    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16\": container with ID starting with c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16 not found: ID does not exist" containerID="c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"
Oct 31 13:28:50.013314 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.013280    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16"} err="failed to get container status \"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16\": rpc error: code = NotFound desc = could not find container \"c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16\": container with ID starting with c761145159579fa5c586bd6d53f5cabead22fb73c552c88caf6e0f1b0c793a16 not found: ID does not exist"
Oct 31 13:28:50.030276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.030216    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:50.036908 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.036874    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d9cc59bd-g92rl"]
Oct 31 13:28:50.490729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:50.490693    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" path="/var/lib/kubelet/pods/b29fb81c-091f-4531-9c1d-9612ed0cc99f/volumes"
Oct 31 13:28:51.672845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:51.672796    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:51.808403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:51.808369    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:53.016777 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.016737    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:53.179595 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.179529    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:53.195268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.193151    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:28:53.195268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.193753    4958 cpu_manager.go:414] "containerMap: removing container" podUID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" containerName="maas-api"
Oct 31 13:28:53.195268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.193771    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" containerName="maas-api"
Oct 31 13:28:53.195268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.193877    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="b29fb81c-091f-4531-9c1d-9612ed0cc99f" containerName="maas-api"
Oct 31 13:28:53.210947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.210910    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:28:53.211116 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.211053    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.216680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.216653    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-351178df-serving-cert\""
Oct 31 13:28:53.317171 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.317058    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:53.394469 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.394431    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.394689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.394503    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.394689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.394572    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.394689 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.394597    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl75g\" (UniqueName: \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.493360 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.493314    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:53.495581 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.495554    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.495769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.495643    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.495769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.495688    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.495769 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.495716    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl75g\" (UniqueName: \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.496432 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.496407    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.498153 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.498127    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.498242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.498157    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.508729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.508708    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl75g\" (UniqueName: \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\") pod \"maas-api-e2e-ait-351178df-6db986db46-k6q2g\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.527699 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.527672    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:53.816316 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:53.816287    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:28:53.817724 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:28:53.817696    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8ac0c7_83a2_4a1e_adef_5b75131eb74c.slice/crio-2fd5515a63259aebb3f13a85bbc9775a95f9c5c00748e6e6ed31a413bca40a1f WatchSource:0}: Error finding container 2fd5515a63259aebb3f13a85bbc9775a95f9c5c00748e6e6ed31a413bca40a1f: Status 404 returned error can't find the container with id 2fd5515a63259aebb3f13a85bbc9775a95f9c5c00748e6e6ed31a413bca40a1f
Oct 31 13:28:54.032318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:54.032275    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" event={"ID":"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c","Type":"ContainerStarted","Data":"2fd5515a63259aebb3f13a85bbc9775a95f9c5c00748e6e6ed31a413bca40a1f"}
Oct 31 13:28:54.188301 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:54.188260    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:55.043203 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:55.043157    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" event={"ID":"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c","Type":"ContainerStarted","Data":"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"}
Oct 31 13:28:55.043707 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:55.043275    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:28:55.069456 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:55.069394    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" podStartSLOduration=1.638714607 podStartE2EDuration="2.069379858s" totalImagesPullingTime="430.665251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:28:55.065960938 +0000 UTC m=+1756.729386623" watchObservedRunningTime="2026-10-31 13:28:55.069379858 +0000 UTC m=+1756.732805592"
Oct 31 13:28:55.106687 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:55.106650    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:55.994437 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:55.994394    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:56.801874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:56.801829    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:57.696998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:57.696962    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:58.562671 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:58.562592    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:59.387334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:28:59.387300    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:28:59.575147 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:28:59.575112    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:29:00.121181 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:00.121146    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:00.877253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:00.877221    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:01.056491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:01.056462    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:29:01.708276 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:01.708241    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:02.550720 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:02.550681    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:03.380253 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:03.380223    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:04.171160 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:04.171121    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:04.915369 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:04.914651    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:05.695898 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:05.695863    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:06.172055 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:06.172021    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:06.305760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:06.305739    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:06.506331 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:06.506293    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:07.278661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:07.278624    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:08.291984 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:08.291929    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:09.014415 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:09.014378    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:09.805582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:09.805536    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:10.687313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:10.687271    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:11.483360 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:11.483314    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:12.291101 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:12.291064    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:13.105874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:13.105818    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:13.939839 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:13.939805    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:14.712169 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:14.712127    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:15.494132 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:15.494086    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:16.289865 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:16.289825    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:17.091797 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:17.091758    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:17.765820 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:17.765778    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:17.768149 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:17.767400    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:29:17.768149 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:17.767616    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" podUID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" containerName="maas-api" containerID="cri-o://b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f" gracePeriod=30
Oct 31 13:29:17.900924 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:17.900854    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:18.084824 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.084795    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:29:18.147394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.146791    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\") pod \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") "
Oct 31 13:29:18.147394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.146915    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\") pod \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") "
Oct 31 13:29:18.147394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.147000    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\") pod \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") "
Oct 31 13:29:18.147394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.147051    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\" (UniqueName: \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\") pod \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\" (UID: \"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c\") "
Oct 31 13:29:18.147394 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.147263    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca" pod "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" (UID: "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:29:18.147846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.147480    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:29:18.150143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.149981    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls" pod "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" (UID: "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:29:18.150143 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.150101    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs" pod "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" (UID: "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:29:18.152760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.152670    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g" pod "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" (UID: "ba8ac0c7-83a2-4a1e-adef-5b75131eb74c"). InnerVolumeSpecName "kube-api-access-vl75g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:29:18.155109 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.155076    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:18.191066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.190233    4958 generic.go:356] "Generic (PLEG): container finished" podID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" containerID="b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f" exitCode=0
Oct 31 13:29:18.191066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.190300    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" event={"ID":"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c","Type":"ContainerDied","Data":"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"}
Oct 31 13:29:18.191066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.190391    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g" event={"ID":"ba8ac0c7-83a2-4a1e-adef-5b75131eb74c","Type":"ContainerDied","Data":"2fd5515a63259aebb3f13a85bbc9775a95f9c5c00748e6e6ed31a413bca40a1f"}
Oct 31 13:29:18.191066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.190419    4958 scope.go:122] "RemoveContainer" containerID="b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"
Oct 31 13:29:18.191066 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.190569    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"
Oct 31 13:29:18.207495 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.207473    4958 scope.go:122] "RemoveContainer" containerID="b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"
Oct 31 13:29:18.207857 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:29:18.207834    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f\": container with ID starting with b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f not found: ID does not exist" containerID="b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"
Oct 31 13:29:18.207920 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.207867    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f"} err="failed to get container status \"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f\": rpc error: code = NotFound desc = could not find container \"b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f\": container with ID starting with b4f195d71628af7ecb3afb51faf92d901f78e4de0b702d8b4434b84a821b0f2f not found: ID does not exist"
Oct 31 13:29:18.217901 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.217842    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:29:18.226281 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.226244    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-351178df-6db986db46-k6q2g"]
Oct 31 13:29:18.248845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.248805    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:29:18.248845 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.248845    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:29:18.249131 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.248867    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl75g\" (UniqueName: \"kubernetes.io/projected/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c-kube-api-access-vl75g\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:29:18.285449 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.285411    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:18.491934 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:18.491897    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" path="/var/lib/kubelet/pods/ba8ac0c7-83a2-4a1e-adef-5b75131eb74c/volumes"
Oct 31 13:29:23.990967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:23.990931    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:25.286246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:25.286210    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:25.761357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:25.761319    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:25.902928 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:25.902886    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:29.577298 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:29:29.577253    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:29:29.643021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:29.642978    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:29.786333 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:29.786293    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:30.362927 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.362886    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:30.859371 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.859309    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:30.897597 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.897566    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:29:30.898282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.898256    4958 cpu_manager.go:414] "containerMap: removing container" podUID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" containerName="maas-api"
Oct 31 13:29:30.898282 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.898279    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" containerName="maas-api"
Oct 31 13:29:30.898467 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.898358    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba8ac0c7-83a2-4a1e-adef-5b75131eb74c" containerName="maas-api"
Oct 31 13:29:30.901864 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.901841    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:30.923870 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.923829    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:29:30.925975 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.925945    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-9c81e5-serving-cert\""
Oct 31 13:29:30.997519 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.997486    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:30.997713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.997540    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfkf\" (UniqueName: \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:30.997713 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.997687    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:30.997799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:30.997732    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.018233 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.018206    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:31.098849 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.098811    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.099056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.098871    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfkf\" (UniqueName: \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.099056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.098926    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.099056 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.098956    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.099702 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.099671    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.101998 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.101974    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.102122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.102008    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.112305 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.112235    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfkf\" (UniqueName: \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\") pod \"maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.152813 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.152781    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:31.233077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.233043    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:31.296875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.295219    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:31.523138 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.523103    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:29:31.524339 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:29:31.524313    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223c805d_b158_4465_bd13_ab8d8f62a8a1.slice/crio-c31a38fc24b591cacbbe0f3359f4a68e6e7d3faa446d56fa283bcc4502d4402d WatchSource:0}: Error finding container c31a38fc24b591cacbbe0f3359f4a68e6e7d3faa446d56fa283bcc4502d4402d: Status 404 returned error can't find the container with id c31a38fc24b591cacbbe0f3359f4a68e6e7d3faa446d56fa283bcc4502d4402d
Oct 31 13:29:31.815906 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:31.815827    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:32.282909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:32.282872    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" event={"ID":"223c805d-b158-4465-bd13-ab8d8f62a8a1","Type":"ContainerStarted","Data":"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"}
Oct 31 13:29:32.283420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:32.282929    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" event={"ID":"223c805d-b158-4465-bd13-ab8d8f62a8a1","Type":"ContainerStarted","Data":"c31a38fc24b591cacbbe0f3359f4a68e6e7d3faa446d56fa283bcc4502d4402d"}
Oct 31 13:29:32.283420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:32.282956    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:32.305218 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:32.305165    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" podStartSLOduration=1.874273723 podStartE2EDuration="2.305148573s" totalImagesPullingTime="430.87485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:29:32.304977696 +0000 UTC m=+1793.968403403" watchObservedRunningTime="2026-10-31 13:29:32.305148573 +0000 UTC m=+1793.968574259"
Oct 31 13:29:32.710922 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:32.710887    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:33.555471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:33.555432    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:34.487882 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:34.487841    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:35.287768 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:35.287727    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:36.110215 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:36.110178    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:36.903374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:36.903338    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:37.702334 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:37.702302    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:38.295134 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:38.295105    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:29:38.493002 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:38.492917    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:39.274393 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:39.274355    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:39.510883 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:39.510847    4958 scope.go:122] "RemoveContainer" containerID="4cc3943153331a7dc3c28500c6856c0e7ab045e8d02c37330b3ed2faff61774e"
Oct 31 13:29:40.147874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.147825    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:40.262892 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.262860    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:29:40.270463 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.270440    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:29:40.402584 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.402512    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:29:40.410077 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.410054    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:29:40.911385 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:40.911347    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:41.767785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:41.767754    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:42.507495 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:42.507452    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:43.292484 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:43.292442    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:44.098677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:44.098636    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:44.661423 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:44.661385    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:44.915388 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:44.915285    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:45.790504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:45.790469    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:46.700374 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:46.700335    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:47.558438 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:47.558403    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:48.377874 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:48.377833    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:49.180120 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:49.180077    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:49.985809 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:49.985770    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:50.788089 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:50.788029    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:51.594751 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:51.594710    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:52.384145 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:52.384112    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:53.197513 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:53.197443    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:54.096448 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:54.096410    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:54.903413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:54.903378    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:55.887191 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:55.887154    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:56.704680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:56.704591    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:57.590903 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:57.590860    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:58.309804 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:58.309763    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:59.181881 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:59.181832    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:29:59.573807 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:29:59.573772    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:29:59.940857 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:29:59.940731    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:00.792789 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:00.792752    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:01.600897 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:01.600855    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:02.406420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:02.406385    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:03.218003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:03.217965    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:03.992043 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:03.992004    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:04.797768 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:04.797728    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:05.608005 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:05.607968    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:06.519433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:06.519387    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:07.497497 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:07.497461    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:08.321292 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:08.321244    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:09.230182 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:09.230146    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:10.195403 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:10.195366    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:11.095855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:11.095812    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:11.932871 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:11.932834    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:12.805599 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:12.805562    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:13.649727 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:13.649684    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:14.500991 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:14.500952    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:15.414063 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:15.414026    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:16.033492 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:16.033455    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"]
Oct 31 13:30:16.041573 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:16.041540    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-526tq"]
Oct 31 13:30:16.320827 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:16.320731    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:16.490885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:16.490847    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ec85c2c-d76f-45a7-a92f-94ffea7ef23e" path="/var/lib/kubelet/pods/7ec85c2c-d76f-45a7-a92f-94ffea7ef23e/volumes"
Oct 31 13:30:17.263943 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:17.263903    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:18.124073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:18.124040    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:19.006953 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:19.006905    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:19.912752 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:19.912666    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:20.745307 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:20.745271    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:21.597632 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:21.597562    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:22.400929 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:22.400891    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:23.206061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:23.206024    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:24.098934 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:24.098895    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:24.890482 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:24.890440    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:25.786472 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:25.786440    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:26.607201 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:26.607144    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:27.399834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:27.399795    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:28.206887 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:28.206830    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:28.998327 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:28.998296    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:29.574366 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:30:29.574317    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:30:29.820336 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:29.820293    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:29.963821 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:29.963788    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:30.409017 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:30.408920    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:30.596959 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:30.596920    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:31.396945 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:31.396899    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:32.553527 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:32.553488    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:32.998785 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:32.998754    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:33.936776 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:33.936739    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:34.809732 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:34.809692    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:35.035125 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:35.035083    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"]
Oct 31 13:30:35.038338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:35.038309    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-7ztkc"]
Oct 31 13:30:35.610912 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:35.610864    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:36.490964 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:36.490918    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06749221-ac0d-4f90-8f6c-0b2c88bd2cb1" path="/var/lib/kubelet/pods/06749221-ac0d-4f90-8f6c-0b2c88bd2cb1/volumes"
Oct 31 13:30:36.520189 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:36.520154    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:37.297884 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:37.297851    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:38.200996 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:38.200950    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:39.105124 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:39.105088    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:39.897666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:39.897626    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:40.807830 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:40.807795    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:41.696008 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:41.695951    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:42.515581 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:42.515545    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:43.316137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:43.316097    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:44.159122 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:44.159076    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:45.063661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:45.063599    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:45.906799 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:45.906763    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:46.796189 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:46.796152    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:47.804803 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:47.804766    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:48.616850 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:48.616812    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:49.405417 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:49.405384    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:50.208982 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:50.208934    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:50.992363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:50.992328    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:51.804197 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:51.804152    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:52.702135 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:52.702082    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:53.499070 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:53.499030    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:54.304577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:54.304537    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:55.106139 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:55.106102    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:56.091450 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:56.091410    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:56.805909 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:56.805865    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:57.701286 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:57.701239    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:58.605290 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:58.605248    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:59.558661 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:30:59.558627    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:30:59.574898 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:30:59.574863    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:31:00.404615 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:00.404573    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:01.217784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:01.217746    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:02.072825 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:02.072791    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:02.890206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:02.890164    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:03.783677 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:03.783637    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:04.614634 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:04.614574    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:05.601213 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:05.601180    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:06.518361 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:06.518316    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:07.399834 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:07.399786    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:08.266666 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:08.266630    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:09.108249 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:09.108209    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:10.078876 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:10.078781    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:10.920477 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:10.920431    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:11.814618 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:11.814563    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:12.707522 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:12.707469    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:13.631795 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:13.631757    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:14.536740 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:14.536691    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:15.103794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:15.103743    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:15.246545 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:15.246503    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:15.532871 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:15.532836    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:21.274220 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.274177    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:31:21.274860 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.274443    4958 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" podUID="223c805d-b158-4465-bd13-ab8d8f62a8a1" containerName="maas-api" containerID="cri-o://320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07" gracePeriod=30
Oct 31 13:31:21.372451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.372409    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:21.562110 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.562076    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:31:21.583741 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.583708    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:21.588853 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.588762    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\" (UniqueName: \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\") pod \"223c805d-b158-4465-bd13-ab8d8f62a8a1\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") "
Oct 31 13:31:21.589029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.588879    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\") pod \"223c805d-b158-4465-bd13-ab8d8f62a8a1\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") "
Oct 31 13:31:21.589029 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.588996    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\") pod \"223c805d-b158-4465-bd13-ab8d8f62a8a1\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") "
Oct 31 13:31:21.589144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.589043    4958 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\") pod \"223c805d-b158-4465-bd13-ab8d8f62a8a1\" (UID: \"223c805d-b158-4465-bd13-ab8d8f62a8a1\") "
Oct 31 13:31:21.589295 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.589266    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca" pod "223c805d-b158-4465-bd13-ab8d8f62a8a1" (UID: "223c805d-b158-4465-bd13-ab8d8f62a8a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 13:31:21.589596 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.589562    4958 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/223c805d-b158-4465-bd13-ab8d8f62a8a1-openshift-service-ca\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:31:21.592205 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.592163    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf" pod "223c805d-b158-4465-bd13-ab8d8f62a8a1" (UID: "223c805d-b158-4465-bd13-ab8d8f62a8a1"). InnerVolumeSpecName "kube-api-access-6wfkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 13:31:21.592413 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.592387    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls" pod "223c805d-b158-4465-bd13-ab8d8f62a8a1" (UID: "223c805d-b158-4465-bd13-ab8d8f62a8a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:31:21.593277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.593237    4958 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs" pod "223c805d-b158-4465-bd13-ab8d8f62a8a1" (UID: "223c805d-b158-4465-bd13-ab8d8f62a8a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 13:31:21.690221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.690179    4958 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-metrics-certs\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:31:21.690221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.690210    4958 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/223c805d-b158-4465-bd13-ab8d8f62a8a1-maas-api-tls\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:31:21.690221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.690220    4958 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfkf\" (UniqueName: \"kubernetes.io/projected/223c805d-b158-4465-bd13-ab8d8f62a8a1-kube-api-access-6wfkf\") on node \"ip-10-0-134-236.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 13:31:21.714923 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:21.714889    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:22.001731 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.001686    4958 generic.go:356] "Generic (PLEG): container finished" podID="223c805d-b158-4465-bd13-ab8d8f62a8a1" containerID="320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07" exitCode=0
Oct 31 13:31:22.001915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.001736    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" event={"ID":"223c805d-b158-4465-bd13-ab8d8f62a8a1","Type":"ContainerDied","Data":"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"}
Oct 31 13:31:22.001915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.001761    4958 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"
Oct 31 13:31:22.001915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.001820    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf" event={"ID":"223c805d-b158-4465-bd13-ab8d8f62a8a1","Type":"ContainerDied","Data":"c31a38fc24b591cacbbe0f3359f4a68e6e7d3faa446d56fa283bcc4502d4402d"}
Oct 31 13:31:22.001915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.001852    4958 scope.go:122] "RemoveContainer" containerID="320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"
Oct 31 13:31:22.012690 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.012669    4958 scope.go:122] "RemoveContainer" containerID="320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"
Oct 31 13:31:22.013020 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:31:22.012993    4958 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07\": container with ID starting with 320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07 not found: ID does not exist" containerID="320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"
Oct 31 13:31:22.013076 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.013034    4958 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07"} err="failed to get container status \"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07\": rpc error: code = NotFound desc = could not find container \"320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07\": container with ID starting with 320db42405ffe61ed1532548505b5b96f1ab6ac84996b145ba20427f9b196e07 not found: ID does not exist"
Oct 31 13:31:22.030759 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.030722    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:31:22.042934 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.042902    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-9c81e5-bddc8b557-jhkhf"]
Oct 31 13:31:22.185746 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.185711    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:22.491155 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:22.491122    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="223c805d-b158-4465-bd13-ab8d8f62a8a1" path="/var/lib/kubelet/pods/223c805d-b158-4465-bd13-ab8d8f62a8a1/volumes"
Oct 31 13:31:28.875192 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:28.875153    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:29.010523 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:29.010486    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:29.281206 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:29.281170    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:29.576829 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:31:29.576744    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:31:30.454896 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:30.454858    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:39.563630 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:39.562659    4958 scope.go:122] "RemoveContainer" containerID="65986e7c1452fc2c2195cb25417c787660d29b12c131177f4770fe56b46c4bb9"
Oct 31 13:31:39.583272 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:39.582826    4958 scope.go:122] "RemoveContainer" containerID="94d21e9e9d25cd6f589d10c83693752f07861ce90cb263976f8a6d6a50387340"
Oct 31 13:31:49.365078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:49.365036    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:57.026572 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:57.026468    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:57.166107 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:31:57.166072    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:31:59.573141 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:31:59.573103    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:32:19.111722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:19.111671    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f9bd99bd7-xgjh6_bccdfb5f-3fa7-4e49-bf95-038ba12b269b/authorino/0.log"
Oct 31 13:32:29.573078 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:32:29.573025    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:32:29.719583 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:29.719549    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5b47c5f478-vbcwg_7e0c3990-fbbc-4f04-b612-00299831ff6b/manager/0.log"
Oct 31 13:32:30.360680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:30.360646    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:32:30.535347 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:30.535306    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:32:30.581176 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:30.581133    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:32:30.680790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:30.680699    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:32:30.961543 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:30.961509    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zf6qv_b52cbb41-fdb5-4f53-95b7-da66829b302f/manager/0.log"
Oct 31 13:32:31.165764 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:31.165729    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-79vlx_346a7c42-c6fa-4412-9954-70b692784be6/proxy/0.log"
Oct 31 13:32:32.078851 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:32.078822    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7df6dd5c76-hqqrs_aa9aea0d-624f-4512-aaa3-5aa2dae8661c/maas-api/0.log"
Oct 31 13:32:32.439436 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:32.439348    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-rsnzd_c008c89e-c443-418e-a1e0-e5a4c4c7975a/revoke-keys/0.log"
Oct 31 13:32:32.618202 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:32.618170    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-452b6d7b-5t7xs_b99bab5f-dc7f-4b6e-aaff-0916b105b47d/revoke-keys/0.log"
Oct 31 13:32:32.968369 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:32.968338    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c9f3f15c-m26ql_e9bb9fb2-8f43-4a87-b46b-41448958c373/revoke-keys/0.log"
Oct 31 13:32:33.310246 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:33.310152    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-sffcv_61d26d7c-4459-4c21-b845-df77b2980f1d/postgres/0.log"
Oct 31 13:32:33.774078 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:33.774045    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:32:34.807831 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:34.807801    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f9bd99bd7-xgjh6_bccdfb5f-3fa7-4e49-bf95-038ba12b269b/authorino/0.log"
Oct 31 13:32:35.220280 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:35.220246    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vwpqq_c3bc6ec3-6986-487c-bb9e-76e54343d380/manager/0.log"
Oct 31 13:32:35.595542 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:35.595461    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-twjxs_9377bae1-10ee-4e39-a987-b64fef0334ce/manager/0.log"
Oct 31 13:32:36.742190 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:36.742142    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf_a6c277b4-6402-4ff1-b618-a5ddfcace48f/istio-proxy/0.log"
Oct 31 13:32:37.289318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:37.289285    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776d875d45-zhg8v_db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7/kube-auth-proxy/0.log"
Oct 31 13:32:37.476662 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:37.476595    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/1.log"
Oct 31 13:32:38.223973 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:38.223932    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bmrjc_f3e7c5fa-8d1f-4eeb-b751-29f89354870f/istio-proxy/0.log"
Oct 31 13:32:38.402967 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:38.402932    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-ckhwx_97ae0c6b-03b6-483f-b261-b292222e09a8/istio-proxy/0.log"
Oct 31 13:32:39.290318 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:39.290286    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt_a9345fc7-e94c-41ca-9c20-040563b0e21e/istio-proxy/0.log"
Oct 31 13:32:39.466726 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:39.466682    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z4vmd_fcb13701-f912-4e8f-bebf-224b7961db0d/payload-pre-processing/0.log"
Oct 31 13:32:39.641079 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:39.641004    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:32:39.818947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:39.818919    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f9757499-rkffd_83af181e-1103-408a-8ac2-b824f97cb619/router/0.log"
Oct 31 13:32:40.242770 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:40.242734    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/0.log"
Oct 31 13:32:40.963181 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:40.963147    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-47ncd_9d2c6943-45b9-4289-bae9-8e2a58277a2e/main/0.log"
Oct 31 13:32:41.311915 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:41.311838    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-2d9pm_95a8a6be-4e22-4fe6-9748-c09d14e75fbe/main/0.log"
Oct 31 13:32:41.679162 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:41.679086    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-phqcd_b632adad-3bd9-4a9b-a19a-decf5cbaad88/main/0.log"
Oct 31 13:32:41.858842 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:41.858816    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-znknb_109b96d7-5cce-4f03-93b3-96dcacc4c5e1/main/0.log"
Oct 31 13:32:42.921847 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:42.921813    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f9bd99bd7-xgjh6_bccdfb5f-3fa7-4e49-bf95-038ba12b269b/authorino/0.log"
Oct 31 13:32:46.032027 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:46.031988    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"]
Oct 31 13:32:46.035758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:46.035725    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-5t7xs"]
Oct 31 13:32:46.495628 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:46.495574    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b99bab5f-dc7f-4b6e-aaff-0916b105b47d" path="/var/lib/kubelet/pods/b99bab5f-dc7f-4b6e-aaff-0916b105b47d/volumes"
Oct 31 13:32:52.097895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:52.097858    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5b47c5f478-vbcwg_7e0c3990-fbbc-4f04-b612-00299831ff6b/manager/0.log"
Oct 31 13:32:52.888061 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:52.888028    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:32:53.282023 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:53.281986    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zf6qv_b52cbb41-fdb5-4f53-95b7-da66829b302f/manager/0.log"
Oct 31 13:32:53.499187 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:53.499153    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-79vlx_346a7c42-c6fa-4412-9954-70b692784be6/proxy/0.log"
Oct 31 13:32:54.302015 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:54.301977    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7df6dd5c76-hqqrs_aa9aea0d-624f-4512-aaa3-5aa2dae8661c/maas-api/0.log"
Oct 31 13:32:54.672765 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:54.672687    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-rsnzd_c008c89e-c443-418e-a1e0-e5a4c4c7975a/revoke-keys/0.log"
Oct 31 13:32:55.022055 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:55.022027    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c9f3f15c-m26ql_e9bb9fb2-8f43-4a87-b46b-41448958c373/revoke-keys/0.log"
Oct 31 13:32:55.388324 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:55.388241    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-sffcv_61d26d7c-4459-4c21-b845-df77b2980f1d/postgres/0.log"
Oct 31 13:32:56.480716 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:56.480680    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f9bd99bd7-xgjh6_bccdfb5f-3fa7-4e49-bf95-038ba12b269b/authorino/0.log"
Oct 31 13:32:56.946434 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:56.946348    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vwpqq_c3bc6ec3-6986-487c-bb9e-76e54343d380/manager/0.log"
Oct 31 13:32:57.293146 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:57.293111    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-twjxs_9377bae1-10ee-4e39-a987-b64fef0334ce/manager/0.log"
Oct 31 13:32:58.245019 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:58.244985    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf_a6c277b4-6402-4ff1-b618-a5ddfcace48f/istio-proxy/0.log"
Oct 31 13:32:58.780507 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:58.780477    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776d875d45-zhg8v_db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7/kube-auth-proxy/0.log"
Oct 31 13:32:58.969895 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:58.969859    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/1.log"
Oct 31 13:32:59.573179 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:32:59.573065    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:32:59.723582 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:59.723537    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bmrjc_f3e7c5fa-8d1f-4eeb-b751-29f89354870f/istio-proxy/0.log"
Oct 31 13:32:59.905433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:32:59.905348    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-ckhwx_97ae0c6b-03b6-483f-b261-b292222e09a8/istio-proxy/0.log"
Oct 31 13:33:00.850262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:00.850225    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt_a9345fc7-e94c-41ca-9c20-040563b0e21e/istio-proxy/0.log"
Oct 31 13:33:01.026433 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:01.026400    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z4vmd_fcb13701-f912-4e8f-bebf-224b7961db0d/payload-pre-processing/0.log"
Oct 31 13:33:01.205696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:01.205600    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:33:01.385652 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:01.385600    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f9757499-rkffd_83af181e-1103-408a-8ac2-b824f97cb619/router/0.log"
Oct 31 13:33:02.095550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:02.095519    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-47ncd_9d2c6943-45b9-4289-bae9-8e2a58277a2e/main/0.log"
Oct 31 13:33:02.458221 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:02.458194    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-2d9pm_95a8a6be-4e22-4fe6-9748-c09d14e75fbe/main/0.log"
Oct 31 13:33:02.823679 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:02.823575    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-phqcd_b632adad-3bd9-4a9b-a19a-decf5cbaad88/main/0.log"
Oct 31 13:33:03.002225 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:03.002191    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-znknb_109b96d7-5cce-4f03-93b3-96dcacc4c5e1/main/0.log"
Oct 31 13:33:12.027126 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:12.027084    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"]
Oct 31 13:33:12.029808 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:12.029779    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-rsnzd"]
Oct 31 13:33:12.490648 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:12.490584    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c008c89e-c443-418e-a1e0-e5a4c4c7975a" path="/var/lib/kubelet/pods/c008c89e-c443-418e-a1e0-e5a4c4c7975a/volumes"
Oct 31 13:33:29.573184 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:33:29.573070    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:33:30.591773 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:30.591730    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:33:33.031003 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:33.030969    4958 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"]
Oct 31 13:33:33.035285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:33.035253    4958 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c9f3f15c-m26ql"]
Oct 31 13:33:34.490357 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:34.490322    4958 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9bb9fb2-8f43-4a87-b46b-41448958c373" path="/var/lib/kubelet/pods/e9bb9fb2-8f43-4a87-b46b-41448958c373/volumes"
Oct 31 13:33:41.051577 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:41.051542    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:33:41.307338 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:41.307254    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:33:42.055585 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:42.055551    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:33:42.227022 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:33:42.226993    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:33:59.573302 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:33:59.573262    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:34:29.572458 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:34:29.572418    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:34:30.641307 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:30.641265    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:34:34.871422 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:34.871388    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:34:35.101758 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:35.101721    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:34:35.778072 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:35.778041    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:34:35.968639 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:35.968579    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:34:36.302992 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.302955    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xtmm/must-gather-t47ln"]
Oct 31 13:34:36.304471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.304437    4958 cpu_manager.go:414] "containerMap: removing container" podUID="223c805d-b158-4465-bd13-ab8d8f62a8a1" containerName="maas-api"
Oct 31 13:34:36.304471 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.304468    4958 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="223c805d-b158-4465-bd13-ab8d8f62a8a1" containerName="maas-api"
Oct 31 13:34:36.304710 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.304694    4958 memory_manager.go:365] "RemoveStaleState removing state" podUID="223c805d-b158-4465-bd13-ab8d8f62a8a1" containerName="maas-api"
Oct 31 13:34:36.308048 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.308028    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.313085 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.313056    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xtmm\"/\"openshift-service-ca.crt\""
Oct 31 13:34:36.313195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.313142    4958 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xtmm\"/\"default-dockercfg-c9924\""
Oct 31 13:34:36.313195 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.313141    4958 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xtmm\"/\"kube-root-ca.crt\""
Oct 31 13:34:36.323238 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.323208    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xtmm/must-gather-t47ln"]
Oct 31 13:34:36.328535 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.328507    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:34:36.405932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.405895    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-must-gather-output\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.405932 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.405933    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj8b6\" (UniqueName: \"kubernetes.io/projected/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-kube-api-access-sj8b6\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.468257 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.468224    4958 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log" limit=1024
Oct 31 13:34:36.507465 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.507430    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-must-gather-output\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.507465 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.507468    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj8b6\" (UniqueName: \"kubernetes.io/projected/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-kube-api-access-sj8b6\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.507807 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.507785    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-must-gather-output\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.520550 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.520512    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj8b6\" (UniqueName: \"kubernetes.io/projected/968b7d27-04b9-4e5b-8cb4-4f9128c8a19f-kube-api-access-sj8b6\") pod \"must-gather-t47ln\" (UID: \"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f\") " pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.623313 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.623208    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xtmm/must-gather-t47ln"
Oct 31 13:34:36.902536 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.902506    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xtmm/must-gather-t47ln"]
Oct 31 13:34:36.904692 ip-10-0-134-236 kubenswrapper[4958]: W1031 13:34:36.904651    4958 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod968b7d27_04b9_4e5b_8cb4_4f9128c8a19f.slice/crio-fdc0d559f2f438839207176fb049837c35fb8c5f2011c12db15c1a767bb79fed WatchSource:0}: Error finding container fdc0d559f2f438839207176fb049837c35fb8c5f2011c12db15c1a767bb79fed: Status 404 returned error can't find the container with id fdc0d559f2f438839207176fb049837c35fb8c5f2011c12db15c1a767bb79fed
Oct 31 13:34:36.907009 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:36.906986    4958 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 13:34:37.304493 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:37.304455    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xtmm/must-gather-t47ln" event={"ID":"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f","Type":"ContainerStarted","Data":"fdc0d559f2f438839207176fb049837c35fb8c5f2011c12db15c1a767bb79fed"}
Oct 31 13:34:38.318638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:38.316886    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xtmm/must-gather-t47ln" event={"ID":"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f","Type":"ContainerStarted","Data":"34e78f0673f50b85df0aab59f99059208012ee57deb4382d27b51ea054686e59"}
Oct 31 13:34:38.318638 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:38.316958    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xtmm/must-gather-t47ln" event={"ID":"968b7d27-04b9-4e5b-8cb4-4f9128c8a19f","Type":"ContainerStarted","Data":"1c98b33efeb7838ec899e119fe4a1fcb0b925e56e61b91451b53c4588903ae5f"}
Oct 31 13:34:38.341073 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:38.341009    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8xtmm/must-gather-t47ln" podStartSLOduration=1.471824693 podStartE2EDuration="2.340985911s" totalImagesPullingTime="869.161218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 13:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:34:38.336941337 +0000 UTC m=+2100.000367026" watchObservedRunningTime="2026-10-31 13:34:38.340985911 +0000 UTC m=+2100.004411603"
Oct 31 13:34:39.640728 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:39.640691    4958 scope.go:122] "RemoveContainer" containerID="ed7097cf9724339fde434ef77ed62aa58c77579e2f515c794d46e77a1ef78540"
Oct 31 13:34:39.654504 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:39.654477    4958 scope.go:122] "RemoveContainer" containerID="9276f1b29847460efd6284f158920a175ffb487559e35cef34ed3984cdebcda5"
Oct 31 13:34:39.665564 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:39.665541    4958 scope.go:122] "RemoveContainer" containerID="548af8da191656057335a3b7879c443e6820d8cff0768d52f08273e59bfda99b"
Oct 31 13:34:40.106893 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.106860    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jg2rt_4e5b53af-d841-4059-a555-4f61e331449d/global-pull-secret-syncer/0.log"
Oct 31 13:34:40.251709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.251678    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-7z2j5_6bd73d4b-84b4-4315-9b73-7e3aa648b9e2/connection-checker/0.log"
Oct 31 13:34:40.284289 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.284255    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-xdvkn_8a491af0-7568-4bdd-8a92-8af22ed4b8a2/connection-checker/0.log"
Oct 31 13:34:40.307885 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.307853    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:34:40.315905 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.315880    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:34:40.318480 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.318450    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-z76m8_71d315b5-1d7a-43ff-bc1d-a76f5306c665/connection-checker/0.log"
Oct 31 13:34:40.372242 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.372166    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8b4lq_eab4d3aa-6217-475e-afde-5888cc0afd88/konnectivity-agent/0.log"
Oct 31 13:34:40.458696 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.458665    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:34:40.466722 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.466697    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7p44t_9a6a0aef-64f6-4163-8d5c-caf1f57f93dd/ovn-acl-logging/0.log"
Oct 31 13:34:40.481784 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:40.481752    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-236.us-east-2.compute.internal_3b35a27b51fd2e2aa7686bff71c7e43c/haproxy/0.log"
Oct 31 13:34:47.666268 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:47.666229    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f9bd99bd7-xgjh6_bccdfb5f-3fa7-4e49-bf95-038ba12b269b/authorino/0.log"
Oct 31 13:34:47.760855 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:47.760827    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-vwpqq_c3bc6ec3-6986-487c-bb9e-76e54343d380/manager/0.log"
Oct 31 13:34:47.861955 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:47.861916    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-twjxs_9377bae1-10ee-4e39-a987-b64fef0334ce/manager/0.log"
Oct 31 13:34:49.367647 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:49.367584    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-xjhnz_1ce5470a-d4b3-4c5a-a8cd-6e928b02f0c7/cluster-monitoring-operator/0.log"
Oct 31 13:34:49.570406 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:49.570367    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnfmf_a427bafc-a239-4669-ac39-4753124da7b4/node-exporter/0.log"
Oct 31 13:34:49.608417 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:49.608368    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnfmf_a427bafc-a239-4669-ac39-4753124da7b4/kube-rbac-proxy/0.log"
Oct 31 13:34:49.637137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:49.637043    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnfmf_a427bafc-a239-4669-ac39-4753124da7b4/init-textfile/0.log"
Oct 31 13:34:50.303053 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.303018    4958 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"]
Oct 31 13:34:50.308209 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.308182    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.317947 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.317919    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"]
Oct 31 13:34:50.400451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.400405    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-sys\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.400451 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.400448    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-podres\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.400986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.400518    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-lib-modules\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.400986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.400585    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-proc\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.400986 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.400628    4958 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvls\" (UniqueName: \"kubernetes.io/projected/3687fe1f-b8d4-4605-951f-8144087940da-kube-api-access-6nvls\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503147    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-proc\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503205    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvls\" (UniqueName: \"kubernetes.io/projected/3687fe1f-b8d4-4605-951f-8144087940da-kube-api-access-6nvls\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503277    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-sys\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503303    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-podres\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503372    4958 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-lib-modules\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503536    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-lib-modules\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.503633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503598    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-proc\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.504159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.503944    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-sys\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.504159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.504004    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3687fe1f-b8d4-4605-951f-8144087940da-podres\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.519650 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.518933    4958 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvls\" (UniqueName: \"kubernetes.io/projected/3687fe1f-b8d4-4605-951f-8144087940da-kube-api-access-6nvls\") pod \"perf-node-gather-daemonset-9hdxd\" (UID: \"3687fe1f-b8d4-4605-951f-8144087940da\") " pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.642226 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.642132    4958 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:50.966435 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:50.952760    4958 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"]
Oct 31 13:34:51.473311 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:51.473268    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd" event={"ID":"3687fe1f-b8d4-4605-951f-8144087940da","Type":"ContainerStarted","Data":"9d9a754cb835b4b4399926f3da8e8d5af414cf4531aa3c9ddc66c21b23f5e427"}
Oct 31 13:34:51.473856 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:51.473330    4958 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd" event={"ID":"3687fe1f-b8d4-4605-951f-8144087940da","Type":"ContainerStarted","Data":"5c193402dca09e14a54d7345f78207f4411b8a0427d24ec4b6a39cf0a58036e5"}
Oct 31 13:34:51.474262 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:51.474235    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:51.498363 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:51.498295    4958 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd" podStartSLOduration=1.498273127 podStartE2EDuration="1.498273127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 13:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 13:34:51.495257566 +0000 UTC m=+2113.158683246" watchObservedRunningTime="2026-10-31 13:34:51.498273127 +0000 UTC m=+2113.161698814"
Oct 31 13:34:51.801846 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:51.801771    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-pn27v_f3a39a10-f9df-4e3e-a387-3d9cc1a58334/networking-console-plugin/0.log"
Oct 31 13:34:52.400719 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:52.400691    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/2.log"
Oct 31 13:34:52.405709 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:52.405682    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvcw2_1a9b93d3-7770-4815-9ede-5488c17e029f/console-operator/3.log"
Oct 31 13:34:53.667285 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:53.667247    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-gkjn2_054bc5de-57fb-4e80-9a9e-9e9597cb112c/volume-data-source-validator/0.log"
Oct 31 13:34:54.949144 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:54.949113    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8qxn7_3927981d-3a6e-44a0-a152-81798795fa9f/dns/0.log"
Oct 31 13:34:54.980490 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:54.980459    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8qxn7_3927981d-3a6e-44a0-a152-81798795fa9f/kube-rbac-proxy/0.log"
Oct 31 13:34:55.199420 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:55.199343    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xfkgh_eda68c79-68ab-4536-b21d-28c8d819f8a3/dns-node-resolver/0.log"
Oct 31 13:34:55.954159 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:55.954122    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pdgpg_b5f1cfdb-416d-4fb6-9f72-e3349e3fcd14/node-ca/0.log"
Oct 31 13:34:57.089790 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:57.089742    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf_a6c277b4-6402-4ff1-b618-a5ddfcace48f/istio-proxy/0.log"
Oct 31 13:34:58.288505 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.288478    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776d875d45-zhg8v_db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7/kube-auth-proxy/0.log"
Oct 31 13:34:58.328087 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.328055    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/0.log"
Oct 31 13:34:58.329786 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.329758    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/1.log"
Oct 31 13:34:58.458224 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.458194    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bmrjc_f3e7c5fa-8d1f-4eeb-b751-29f89354870f/istio-proxy/0.log"
Oct 31 13:34:58.495739 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.495708    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-ckhwx_97ae0c6b-03b6-483f-b261-b292222e09a8/istio-proxy/0.log"
Oct 31 13:34:58.503811 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.503781    4958 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xtmm/perf-node-gather-daemonset-9hdxd"
Oct 31 13:34:58.661260 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.661183    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt_a9345fc7-e94c-41ca-9c20-040563b0e21e/istio-proxy/0.log"
Oct 31 13:34:58.692127 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.692098    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z4vmd_fcb13701-f912-4e8f-bebf-224b7961db0d/payload-pre-processing/0.log"
Oct 31 13:34:58.726137 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.726106    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:34:58.761894 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:34:58.761865    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f9757499-rkffd_83af181e-1103-408a-8ac2-b824f97cb619/router/0.log"
Oct 31 13:34:59.587047 ip-10-0-134-236 kubenswrapper[4958]: E1031 13:34:59.586993    4958 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mq875" containerName="extractor"
Oct 31 13:35:00.296680 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:00.296645    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9tlqt_dcf9a029-b79a-4f07-a747-567708c4d2bc/serve-healthcheck-canary/0.log"
Oct 31 13:35:00.969503 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:00.969467    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf_a6c277b4-6402-4ff1-b618-a5ddfcace48f/istio-proxy/0.log"
Oct 31 13:35:01.115584 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.115529    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-ffdc6_cc2822c2-f4d2-4b60-be36-8377ff659009/insights-operator/1.log"
Oct 31 13:35:01.117655 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.117361    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-ffdc6_cc2822c2-f4d2-4b60-be36-8377ff659009/insights-operator/0.log"
Oct 31 13:35:01.382417 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.382337    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mq875_6129e35b-f819-4c82-9fdf-f51ec2d69bf0/kube-rbac-proxy/0.log"
Oct 31 13:35:01.419633 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.415747    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mq875_6129e35b-f819-4c82-9fdf-f51ec2d69bf0/exporter/0.log"
Oct 31 13:35:01.443523 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.443492    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mq875_6129e35b-f819-4c82-9fdf-f51ec2d69bf0/extractor/0.log"
Oct 31 13:35:01.586579 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:01.586525    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-7m5fv-b2fjn_87300d62-5674-4798-8525-a902249459c5/insights-gathering/0.log"
Oct 31 13:35:02.192134 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.192096    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776d875d45-zhg8v_db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7/kube-auth-proxy/0.log"
Oct 31 13:35:02.216238 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.216203    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/0.log"
Oct 31 13:35:02.217491 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.217465    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/1.log"
Oct 31 13:35:02.305277 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.305242    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bmrjc_f3e7c5fa-8d1f-4eeb-b751-29f89354870f/istio-proxy/0.log"
Oct 31 13:35:02.322640 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.322574    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-ckhwx_97ae0c6b-03b6-483f-b261-b292222e09a8/istio-proxy/0.log"
Oct 31 13:35:02.435075 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.435044    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt_a9345fc7-e94c-41ca-9c20-040563b0e21e/istio-proxy/0.log"
Oct 31 13:35:02.456193 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.456116    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z4vmd_fcb13701-f912-4e8f-bebf-224b7961db0d/payload-pre-processing/0.log"
Oct 31 13:35:02.474760 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.474735    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:35:02.499794 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:02.499764    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f9757499-rkffd_83af181e-1103-408a-8ac2-b824f97cb619/router/0.log"
Oct 31 13:35:04.485629 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:04.485566    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-849556f89d-jjxvk_1fb918ae-537d-43d7-9754-383fe9478f18/manager/0.log"
Oct 31 13:35:04.510062 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:04.510029    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-849556f89d-jjxvk_1fb918ae-537d-43d7-9754-383fe9478f18/copy-manifests/0.log"
Oct 31 13:35:04.578718 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:04.578686    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7cfc97f8f7xpmpf_a6c277b4-6402-4ff1-b618-a5ddfcace48f/istio-proxy/0.log"
Oct 31 13:35:05.714653 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.714620    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-8c9tx_86528eb1-0135-48e3-9f14-a03c01b3349e/jobset-operator/0.log"
Oct 31 13:35:05.852021 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.851990    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776d875d45-zhg8v_db63aeb4-d1e5-431a-a9b0-e6d7a3fc9dd7/kube-auth-proxy/0.log"
Oct 31 13:35:05.878148 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.878118    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/0.log"
Oct 31 13:35:05.879351 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.879326    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-58mdk_8004ca3a-1ba4-4031-a3a0-8daf23610852/istio-proxy/1.log"
Oct 31 13:35:05.966678 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.965718    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bmrjc_f3e7c5fa-8d1f-4eeb-b751-29f89354870f/istio-proxy/0.log"
Oct 31 13:35:05.981325 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:05.981288    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-ckhwx_97ae0c6b-03b6-483f-b261-b292222e09a8/istio-proxy/0.log"
Oct 31 13:35:06.092990 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.092935    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-65dccbd94c-z66nt_a9345fc7-e94c-41ca-9c20-040563b0e21e/istio-proxy/0.log"
Oct 31 13:35:06.112248 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.112223    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-z4vmd_fcb13701-f912-4e8f-bebf-224b7961db0d/payload-pre-processing/0.log"
Oct 31 13:35:06.132886 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.132836    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-9j4zt_16733691-44ea-4a9e-9961-2c27deab4dd9/payload-processing/0.log"
Oct 31 13:35:06.160875 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.160840    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f9757499-rkffd_83af181e-1103-408a-8ac2-b824f97cb619/router/0.log"
Oct 31 13:35:06.408494 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.408408    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5b47c5f478-vbcwg_7e0c3990-fbbc-4f04-b612-00299831ff6b/manager/0.log"
Oct 31 13:35:06.850729 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:06.850693    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bd9ffcfc7-88nxh_3456e033-eb8e-4101-842b-fb39109929e5/manager/0.log"
Oct 31 13:35:07.198711 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:07.198631    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zf6qv_b52cbb41-fdb5-4f53-95b7-da66829b302f/manager/0.log"
Oct 31 13:35:07.226828 ip-10-0-134-236 kubenswrapper[4958]: I1031 13:35:07.226798    4958 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-79vlx_346a7c42-c6fa-4412-9954-70b692784be6/proxy/0.log"