Jul 21 16:22:54.614297 ip-10-0-141-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:22:54.614313 ip-10-0-141-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:22:54.614324 ip-10-0-141-38 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:22:54.614651 ip-10-0-141-38 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:23:04.699118 ip-10-0-141-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:23:04.699137 ip-10-0-141-38 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a29001467b7a49668f0032079cc03adc --
Jul 21 16:24:59.412622 ip-10-0-141-38 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:24:59.871564 ip-10-0-141-38 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:24:59.871564 ip-10-0-141-38 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:24:59.871564 ip-10-0-141-38 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:24:59.871564 ip-10-0-141-38 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:24:59.871564 ip-10-0-141-38 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:24:59.873448 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.873326    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879402    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879420    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879424    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879428    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879431    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.879425 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879434    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879438    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879441    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879443    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879446    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879449    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879454    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879459    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879462    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879465    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879469    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879472    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879475    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879479    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879482    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879484    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879487    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879490    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879493    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.879662 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879496    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879499    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879502    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879505    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879507    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879510    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879513    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879515    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879518    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879521    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879524    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879527    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879530    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879533    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879536    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879539    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879542    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879545    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879548    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879550    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.880146 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879553    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879556    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879559    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879562    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879565    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879567    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879570    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879573    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879576    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879579    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879582    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879584    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879587    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879590    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879592    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879595    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879598    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879601    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879604    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879606    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.880681 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879609    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879612    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879615    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879618    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879621    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879624    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879628    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879633    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879636    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879639    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879641    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879644    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879647    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879650    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879653    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879656    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879658    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879661    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879664    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.881188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879668    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879675    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879679    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879682    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879686    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879689    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879691    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879694    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879697    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879700    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879703    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879705    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879709    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879711    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879714    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.879717    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880472    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880480    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880484    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880487    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.881703 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880490    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880493    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880496    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880498    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880501    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880504    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880506    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880509    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880512    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880515    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880518    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880521    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880523    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880529    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880532    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880537    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880541    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880546    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880550    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880554    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.882227 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880558    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880562    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880567    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880571    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880574    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880576    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880580    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880584    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880586    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880589    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880592    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880597    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880601    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880605    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880609    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880612    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880615    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880618    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880620    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.882773 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880623    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880626    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880629    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880631    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880634    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880636    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880639    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880643    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880646    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880648    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880651    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880654    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880656    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880659    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880662    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880665    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880672    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880676    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.883286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880681    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880685    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880688    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880692    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880695    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880699    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880701    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880704    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880707    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880710    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880713    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880716    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880719    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880722    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880724    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880727    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880730    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880733    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880736    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.883808 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880738    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880741    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880744    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880747    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880750    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880753    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880756    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880758    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880763    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880766    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880769    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880772    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880775    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880778    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880781    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880784    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880787    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.880790    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881231    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881238    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.884311 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881242    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881246    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881249    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881253    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881255    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881258    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881261    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881264    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881267    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881270    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881274    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881277    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881280    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881283    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881286    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881290    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881292    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881295    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881298    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881300    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.884898 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881303    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881306    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881309    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881312    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881314    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881318    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881321    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881324    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881327    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881330    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881333    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881337    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881341    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881344    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881347    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881350    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881353    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881356    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881360    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.885434 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881363    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881366    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881368    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881372    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881375    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881378    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881380    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881398    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881401    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881404    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881407    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881410    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881413    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881416    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881418    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881421    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881424    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881426    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881430    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881433    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.885967 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881436    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881438    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881441    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881444    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881446    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881449    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881452    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881455    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881458    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881460    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881463    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881466    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881468    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881471    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881474    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881480    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881485    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881489    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881493    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.886527 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881496    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881499    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881502    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881505    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881508    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881511    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881514    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881517    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881520    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881522    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881525    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881528    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881531    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881534    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881537    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881540    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881543    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881545    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.881548    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881626    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:24:59.887030 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881637    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881649    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881656    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881662    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881668    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881677    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881683    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881686    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881690    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881693    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881697    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881700    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881703    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881707    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881710    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881715    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881719    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881723    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881726    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881730    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881733    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881737    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881741    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:24:59.887594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881744    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881748    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881751    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881754    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881757    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881760    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881764    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881767    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881771    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881774    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881777    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881780    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881783    2577 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881787    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881800    2577 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881803    2577 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881806    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881810    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881813    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881817    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881820    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881823    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881827    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881830    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881833    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:24:59.888176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881838    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881849    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881853    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881856    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881858    2577 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881863    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881866    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881870    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881874    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881877    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881881    2577 flags.go:64] FLAG: --help="false"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881884    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-38.ec2.internal"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881887    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881890    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881893    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881897    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881901    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881904    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881907    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881909    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881912    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881917    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881920    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881923    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:24:59.888845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881926    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881929    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881932    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881935    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881938    2577 flags.go:64] FLAG: --lock-file=""
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881941    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881944    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881948    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881953    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881957    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881960    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881963    2577 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881966    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881970    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881973    2577 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881976    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881981    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881984    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881988    2577 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881991    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881995    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.881998    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882001    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882004    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882007    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:24:59.889501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882010    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882017    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882021    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882024    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882028    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882031    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882037    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882040    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882043    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882046    2577 flags.go:64] FLAG: --port="10250"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882050    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882053    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0313379619012ebdb"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882057    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882060    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882063    2577 flags.go:64] FLAG: --register-node="true"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882066    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882069    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882073    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882076    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882078    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882083    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882086    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882089    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882092    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882095    2577 flags.go:64] FLAG: --runonce="false"
Jul 21 16:24:59.890170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882098    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882101    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882104    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882107    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882110    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882113    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882116    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882119    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882122    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882125    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882128    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882133    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882136    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882139    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882142    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882148    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882151    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882154    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882158    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882161    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882164    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882167    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882170    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882173    2577 flags.go:64] FLAG: --v="2"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882178    2577 flags.go:64] FLAG: --version="false"
Jul 21 16:24:59.890853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882183    2577 flags.go:64] FLAG: --vmodule=""
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882191    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.882198    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882329    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882333    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882336    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882340    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882344    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882348    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882351    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882354    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882357    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882360    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882363    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882365    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882368    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882370    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882373    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882378    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.891534 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882395    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882398    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882401    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882404    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882406    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882409    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882412    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882415    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882418    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882421    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882424    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882426    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882429    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882432    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882435    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882440    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882443    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882446    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882448    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882451    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.892040 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882454    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882456    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882459    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882462    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882465    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882468    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882470    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882473    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882476    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882479    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882482    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882486    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882489    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882491    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882494    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882497    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882499    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882502    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882504    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882507    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.892587 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882510    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882513    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882515    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882518    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882521    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882525    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882529    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882534    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882537    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882540    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882544    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882547    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882550    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882554    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882557    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882561    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882564    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882567    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882569    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.893188 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882573    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882575    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882578    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882581    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882586    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882589    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882591    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882594    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882597    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882600    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882602    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882605    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882608    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882611    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882614    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882616    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882619    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882622    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882625    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882628    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.893719 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882632    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882635    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882637    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.882640    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.883235    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.890017    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.890033    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.890808    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.890815    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890893    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890899    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890903    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890907    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890911    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890914    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.894235 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890917    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890920    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890923    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890925    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890928    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890933    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890937    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890940    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890942    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890945    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890948    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890951    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890954    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890957    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890959    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890963    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890965    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890968    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890971    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.894761 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890974    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890978    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890983    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890986    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890990    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890993    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890996    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.890999    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891002    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891006    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891009    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891012    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891015    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891017    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891020    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891023    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891026    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891029    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891032    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891034    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.895270 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891037    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891040    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891044    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891047    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891050    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891052    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891055    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891058    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891061    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891063    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891066    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891069    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891072    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891075    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891078    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891081    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891084    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891087    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891090    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891093    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.895798 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891096    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891099    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891101    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891104    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891107    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891110    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891113    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891115    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891118    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891121    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891123    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891126    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891129    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891132    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891135    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891137    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891140    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891143    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891146    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891149    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.896322 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891152    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891154    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891157    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891160    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891162    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891166    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891169    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891171    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891175    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891178    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891180    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891183    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891186    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891189    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.891194    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:24:59.896842 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891308    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891312    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891315    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891318    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891321    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891324    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891327    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891331    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891334    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891337    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891340    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891343    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891345    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891348    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891351    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891354    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891356    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891359    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891361    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891364    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:24:59.897276 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891367    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891369    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891372    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891377    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891380    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891400    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891404    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891407    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891410    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891413    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891416    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891419    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891421    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891424    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891427    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891430    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891433    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891436    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891438    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891441    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:24:59.897821 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891444    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891447    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891449    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891452    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891455    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891457    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891460    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891463    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891466    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891468    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891471    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891474    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891476    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891479    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891481    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891484    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891487    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891490    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891494    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891496    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:24:59.898347 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891499    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891502    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891504    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891507    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891510    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891512    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891515    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891518    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891520    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891523    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891527    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891531    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891535    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891537    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891540    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891543    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891546    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891549    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891552    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:24:59.898928 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891554    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891557    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891560    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891562    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891565    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891568    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891571    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891573    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891576    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891579    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891584    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891587    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891591    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891594    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891597    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891600    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891603    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891606    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891609    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:24:59.899440 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:24:59.891612    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.891617    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.891717    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.893839    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.895429    2577 server.go:1019] "Starting client certificate rotation"
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.895539    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.895598    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:24:59.899983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.898307    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:24:59.901937 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.901911    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:24:59.912944 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.912924    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:24:59.914936 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.914921    2577 log.go:25] "Validated CRI v1 image API"
Jul 21 16:24:59.915764 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.915738    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:24:59.918330 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.918308    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 89a7490b-dd48-4042-967c-066df83c33a4:/dev/nvme0n1p3 e01e6aba-0a5a-4c26-838e-93ff72fb5080:/dev/nvme0n1p4]
Jul 21 16:24:59.918431 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.918328    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:24:59.925306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.925161    2577 manager.go:216] Machine: {Timestamp:2026-07-21 16:24:59.922379949 +0000 UTC m=+0.374935154 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3067213 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298e0a2867e7321476e88335a5413a SystemUUID:ec298e0a-2867-e732-1476-e88335a5413a BootID:a2900146-7b7a-4966-8f00-32079cc03adc Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:8c:4e:b3:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:8c:4e:b3:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c8:5b:9d:9a:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:24:59.925306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.925292    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:24:59.925492 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.925421    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:24:59.929730 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.929706    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:24:59.929900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.929733    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:24:59.930966 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.930955    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:24:59.931009 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.930969    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:24:59.931009 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.930977    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:24:59.932350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.932337    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:24:59.933634 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.933623    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:24:59.935180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.935160    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:24:59.936794 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.936780    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:24:59.936944 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.936933    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:24:59.936980 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.936966    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:24:59.937010 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.936990    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:24:59.937039 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.937010    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:24:59.937039 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.937023    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:24:59.937039 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.937034    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:24:59.937469 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.937454    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:24:59.937555 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.937480    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:24:59.939771 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.939749    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:24:59.941141 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941122    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:24:59.941221 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941166    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:24:59.941876 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941861    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941882    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941892    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941902    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941913    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941922    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941944    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:24:59.941955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941953    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:24:59.942192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941963    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:24:59.942192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941972    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:24:59.942192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.941994    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:24:59.942192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.942008    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:24:59.943656 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.943641    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:24:59.943726 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.943659    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:24:59.947114 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.947096    2577 server.go:1268] "Started kubelet"
Jul 21 16:24:59.947269 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.947199    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:24:59.947664 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.947430    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:24:59.947801 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.947775    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:24:59.948032 ip-10-0-141-38 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:24:59.948672 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.948651    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:24:59.950558 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.950541    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:24:59.950934 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.950893    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:24:59.951101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.951080    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:24:59.951685 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.951659    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:24:59.954214 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.954191    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:24:59.956992 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.956973    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:24:59.957106 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.957083    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:24:59.957106 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.956974    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:24:59.957689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957599    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:24:59.957689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957615    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:24:59.957689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957632    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:24:59.957892 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957698    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:24:59.957892 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957711    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:24:59.957989 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957897    2577 factory.go:55] Registering systemd factory
Jul 21 16:24:59.957989 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.957910    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:24:59.958166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958149    2577 factory.go:153] Registering CRI-O factory
Jul 21 16:24:59.958166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958166    2577 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:24:59.958320 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958220    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:24:59.958320 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958247    2577 factory.go:103] Registering Raw factory
Jul 21 16:24:59.958320 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958264    2577 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:24:59.958514 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.957162    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-38.ec2.internal.18c45ab84c5af04a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-38.ec2.internal,UID:ip-10-0-141-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-38.ec2.internal,},FirstTimestamp:2026-07-21 16:24:59.947069514 +0000 UTC m=+0.399624721,LastTimestamp:2026-07-21 16:24:59.947069514 +0000 UTC m=+0.399624721,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-38.ec2.internal,}"
Jul 21 16:24:59.958832 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.958682    2577 manager.go:349] Starting recovery of all containers
Jul 21 16:24:59.965898 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.965868    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 16:24:59.966339 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.966311    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 16:24:59.970602 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.970584    2577 manager.go:354] Recovery completed
Jul 21 16:24:59.971855 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.971837    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7lqkz"
Jul 21 16:24:59.975078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.975062    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:24:59.977026 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977008    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:24:59.977098 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977045    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:24:59.977098 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977063    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:24:59.977769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977750    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:24:59.977769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977765    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:24:59.977900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977774    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:24:59.977900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.977784    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:24:59.978536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.978519    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:24:59.978614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.978552    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:24:59.978614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.978568    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:24:59.979418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.979405    2577 policy_none.go:49] "None policy: Start"
Jul 21 16:24:59.979470 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.979422    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:24:59.979470 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.979433    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:24:59.980567 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.980558    2577 policy_none.go:47] "Start"
Jul 21 16:24:59.983496 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:24:59.983478    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7lqkz"
Jul 21 16:24:59.990237 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:24:59.990153    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-38.ec2.internal.18c45ab84e240dc7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-38.ec2.internal,UID:ip-10-0-141-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-38.ec2.internal,},FirstTimestamp:2026-07-21 16:24:59.977027015 +0000 UTC m=+0.429582225,LastTimestamp:2026-07-21 16:24:59.977027015 +0000 UTC m=+0.429582225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-38.ec2.internal,}"
Jul 21 16:25:00.022990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.022931    2577 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:25:00.022990 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.022974    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:25:00.022990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.022988    2577 server.go:87] "Starting device plugin registration server"
Jul 21 16:25:00.023269 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.023254    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:25:00.023329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.023271    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:25:00.023423 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.023401    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:25:00.023532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.023515    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:25:00.023532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.023530    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:25:00.024083 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.024059    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:25:00.024180 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.024113    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.099826 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.099796    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:25:00.101196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.101034    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:25:00.101196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.101075    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:25:00.101196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.101098    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:25:00.101196 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.101135    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:25:00.103636 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.103614    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:00.123778 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.123761    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:00.124640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.124624    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:00.124701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.124657    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:00.124701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.124669    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:00.124701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.124696    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.134411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.134395    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.134468 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.134418    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-38.ec2.internal\": node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.163147 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.163129    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.201685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.201648    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"]
Jul 21 16:25:00.201758 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.201724    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:00.202610 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.202584    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:00.202671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.202620    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:00.202671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.202631    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:00.203932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.203920    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:00.204077 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.204052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.204113 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.204092    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:00.204663 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.204647    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:00.204734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.204677    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:00.204734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.204689    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:00.205323 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.205293    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:00.205389 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.205351    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:00.205389 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.205369    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:00.206689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.206675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.206748 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.206703    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:00.207422 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.207402    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:00.207561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.207435    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:00.207561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.207449    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:00.230248 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.230224    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-38.ec2.internal\" not found" node="ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.234979 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.234962    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-38.ec2.internal\" not found" node="ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.259291 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.259267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18f3f30739cf6a3536e0906fc42f6c19-config\") pod \"kube-apiserver-proxy-ip-10-0-141-38.ec2.internal\" (UID: \"18f3f30739cf6a3536e0906fc42f6c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.259395 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.259305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.259395 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.259361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.263810 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.263797    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.360049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.359965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.360049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.360000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.360049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.360018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18f3f30739cf6a3536e0906fc42f6c19-config\") pod \"kube-apiserver-proxy-ip-10-0-141-38.ec2.internal\" (UID: \"18f3f30739cf6a3536e0906fc42f6c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.360235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.360082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.360235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.360090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6156fb4c23558705bcbe30119a3cfae0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal\" (UID: \"6156fb4c23558705bcbe30119a3cfae0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.360235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.360143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18f3f30739cf6a3536e0906fc42f6c19-config\") pod \"kube-apiserver-proxy-ip-10-0-141-38.ec2.internal\" (UID: \"18f3f30739cf6a3536e0906fc42f6c19\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.364427 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.364409    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.464987 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.464959    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.532868 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.532823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.539379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.539361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:00.565668 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.565646    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.666815 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.666732    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.767897 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.767851    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.868097 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.868068    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.895982 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.895952    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:25:00.896404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.896118    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:25:00.968602 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:00.968531    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:00.988990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.988953    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:20:00 +0000 UTC" deadline="2028-03-01 13:22:35.225651832 +0000 UTC"
Jul 21 16:25:00.989050 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:00.988988    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14132h57m34.236666926s"
Jul 21 16:25:01.038801 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.038762    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:01.040020 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.040005    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:01.040089 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.040036    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:01.040089 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.040047    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:01.069574 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:01.069546    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-38.ec2.internal\" not found"
Jul 21 16:25:01.118357 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.118332    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:01.140857 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.140820    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:01.157212 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.157185    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:01.189738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.189711    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:25:01.190961 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.190945    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal"
Jul 21 16:25:01.206374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.206353    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:25:01.338518 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:01.338481    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6156fb4c23558705bcbe30119a3cfae0.slice/crio-d4a19e452eb5cf7a52ea0bc68f512e9b4e0ed3bee6c1fe033dc6ba024d6056ef WatchSource:0}: Error finding container d4a19e452eb5cf7a52ea0bc68f512e9b4e0ed3bee6c1fe033dc6ba024d6056ef: Status 404 returned error can't find the container with id d4a19e452eb5cf7a52ea0bc68f512e9b4e0ed3bee6c1fe033dc6ba024d6056ef
Jul 21 16:25:01.344471 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.344455    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:25:01.500298 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:01.500273    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f3f30739cf6a3536e0906fc42f6c19.slice/crio-20caf2b67a724497c2957541e814926b0a50aa538aec60745cc0e342656493b5 WatchSource:0}: Error finding container 20caf2b67a724497c2957541e814926b0a50aa538aec60745cc0e342656493b5: Status 404 returned error can't find the container with id 20caf2b67a724497c2957541e814926b0a50aa538aec60745cc0e342656493b5
Jul 21 16:25:01.513816 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.513795    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:01.938184 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.938102    2577 apiserver.go:52] "Watching apiserver"
Jul 21 16:25:01.948227 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.948199    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:25:01.949546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.949521    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-s4v6t","openshift-multus/multus-hqrt5","openshift-multus/network-metrics-daemon-6dtfj","openshift-network-diagnostics/network-check-target-svgc8","kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal","openshift-dns/node-resolver-dgxkf","openshift-image-registry/node-ca-k2zlh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal","openshift-network-operator/iptables-alerter-l7mrm","openshift-ovn-kubernetes/ovnkube-node-sd5wp","kube-system/global-pull-secret-syncer-55rwx","kube-system/konnectivity-agent-fjw5r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4","openshift-cluster-node-tuning-operator/tuned-r67g2"]
Jul 21 16:25:01.951143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.951125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:01.952882 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.952863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:01.954113 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.954095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:01.954195 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:01.954171    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:01.955284 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.955269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:01.955377 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:01.955357    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:01.956277 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.956258    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:25:01.956354 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.956298    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.956439 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.956385    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.956581 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.956556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.957626 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.957607    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:25:01.957943 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.957919    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pwjt5\""
Jul 21 16:25:01.958100 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.958084    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:25:01.958177 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.958163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:25:01.959135 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.959119    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fqvxs\""
Jul 21 16:25:01.959696 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.959680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:01.961400 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.961382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:01.962053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.962032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.962053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.962044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vtrrl\""
Jul 21 16:25:01.962205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.962032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.962901 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.962882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:01.964295 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.964276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:01.965775 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.965756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:01.967334 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.967298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:01.968741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.968723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:01.968819 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:01.968782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:01.971275 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-tmp\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-modprobe-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-hosts-file\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtf7\" (UniqueName: \"kubernetes.io/projected/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-kube-api-access-lmtf7\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlz5b\" (UniqueName: \"kubernetes.io/projected/fa366ece-178c-4273-a045-f47466118b38-kube-api-access-nlz5b\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22778f0b-691f-44c3-aed6-a3718c617ea9-agent-certs\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysconfig\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-kubernetes\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-run\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9b5q\" (UniqueName: \"kubernetes.io/projected/01612e69-4f79-48a8-82dc-17af9d14bdbb-kube-api-access-c9b5q\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-tmp-dir\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa366ece-178c-4273-a045-f47466118b38-serviceca\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvklv\" (UniqueName: \"kubernetes.io/projected/5417bc96-b4c4-43ce-9e92-ee83800a0884-kube-api-access-xvklv\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-systemd\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa366ece-178c-4273-a045-f47466118b38-host\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:01.971866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971842    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22778f0b-691f-44c3-aed6-a3718c617ea9-konnectivity-ca\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-conf\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-sys\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-lib-modules\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-var-lib-kubelet\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.971975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-host\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.972187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.972008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-tuned\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:01.974101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.974079    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.974236 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.974219    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.974310 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.974240    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.974409 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.974359    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.975506 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975457    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.975620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:25:01.975620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.975620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975568    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:25:01.975781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975633    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:25:01.975935 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975913    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:25:01.976017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.975916    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.977370 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.977348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:25:01.977544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.977498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:25:01.977853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.977540    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:25:01.978686 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978348    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcp6m\""
Jul 21 16:25:01.978686 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:25:01.978686 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978506    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.978686 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978673    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:25:01.978932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978760    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:25:01.978932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.978828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mgvjg\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.979053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zcsrq\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.979159    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.979182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dlrxd\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.979663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qwc5p\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.979861    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:25:01.980193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.980118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bkf5d\""
Jul 21 16:25:01.986811 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:01.986790    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:25:02.007998 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.007976    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xb4rt"
Jul 21 16:25:02.019284 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.019223    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xb4rt"
Jul 21 16:25:02.059151 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.059127    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:25:02.072661 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-daemon-config\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtf7\" (UniqueName: \"kubernetes.io/projected/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-kube-api-access-lmtf7\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-etc-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/049ea3f7-33c8-404f-8d09-100b99c32868-host-slash\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-cni-binary-copy\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-bin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.072814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-hostroot\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-device-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvklv\" (UniqueName: \"kubernetes.io/projected/5417bc96-b4c4-43ce-9e92-ee83800a0884-kube-api-access-xvklv\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-netns\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-kubelet\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa366ece-178c-4273-a045-f47466118b38-host\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.072985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-slash\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa366ece-178c-4273-a045-f47466118b38-host\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-systemd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-var-lib-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-conf-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-sys\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-lib-modules\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-var-lib-kubelet\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.073254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-sys\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-host\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-host\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-tuned\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-var-lib-kubelet\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-tmp\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-lib-modules\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlz5b\" (UniqueName: \"kubernetes.io/projected/fa366ece-178c-4273-a045-f47466118b38-kube-api-access-nlz5b\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-script-lib\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/049ea3f7-33c8-404f-8d09-100b99c32868-iptables-alerter-script\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j7k5\" (UniqueName: \"kubernetes.io/projected/049ea3f7-33c8-404f-8d09-100b99c32868-kube-api-access-6j7k5\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.073573    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-system-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-cnibin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.073651    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:02.573625976 +0000 UTC m=+3.026181192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:02.074093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-socket-dir-parent\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-k8s-cni-cncf-io\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073696    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-tmp-dir\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-os-release\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-netd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-socket-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22778f0b-691f-44c3-aed6-a3718c617ea9-konnectivity-ca\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-kubelet\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.073995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-ovn\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-config\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-tmp-dir\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-registration-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82hq9\" (UniqueName: \"kubernetes.io/projected/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kube-api-access-82hq9\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.075031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-conf\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cnibin\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97m4p\" (UniqueName: \"kubernetes.io/projected/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-kube-api-access-97m4p\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-os-release\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-netns\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-modprobe-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-etc-kubernetes\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysconfig\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-kubernetes\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-conf\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-run\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9b5q\" (UniqueName: \"kubernetes.io/projected/01612e69-4f79-48a8-82dc-17af9d14bdbb-kube-api-access-c9b5q\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-log-socket\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-bin\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22778f0b-691f-44c3-aed6-a3718c617ea9-konnectivity-ca\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-env-overrides\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.075854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-systemd\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-systemd-units\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-systemd\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-multus-certs\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-system-cni-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-kubernetes\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-run\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-modprobe-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysconfig\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-sys-fs\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.074974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-hosts-file\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22778f0b-691f-44c3-aed6-a3718c617ea9-agent-certs\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np9wd\" (UniqueName: \"kubernetes.io/projected/feedbd1f-f9cc-4f9d-a448-e739330d3b13-kube-api-access-np9wd\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.076756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-hosts-file\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-sysctl-d\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovn-node-metrics-cert\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-multus\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa366ece-178c-4273-a045-f47466118b38-serviceca\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-kubelet-config\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kz2\" (UniqueName: \"kubernetes.io/projected/e8762e55-e28f-4b17-995d-61980fc1ea69-kube-api-access-c5kz2\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-node-log\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-dbus\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.075638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa366ece-178c-4273-a045-f47466118b38-serviceca\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.077163    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.077314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-etc-tuned\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.077680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.077367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01612e69-4f79-48a8-82dc-17af9d14bdbb-tmp\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.078176 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.078155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22778f0b-691f-44c3-aed6-a3718c617ea9-agent-certs\") pod \"konnectivity-agent-fjw5r\" (UID: \"22778f0b-691f-44c3-aed6-a3718c617ea9\") " pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:02.090223 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.090198    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9b5q\" (UniqueName: \"kubernetes.io/projected/01612e69-4f79-48a8-82dc-17af9d14bdbb-kube-api-access-c9b5q\") pod \"tuned-r67g2\" (UID: \"01612e69-4f79-48a8-82dc-17af9d14bdbb\") " pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.090373 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.090355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtf7\" (UniqueName: \"kubernetes.io/projected/4c11abb4-f1f3-4926-ae0d-b7ea4c165a16-kube-api-access-lmtf7\") pod \"node-resolver-dgxkf\" (UID: \"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16\") " pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.093043 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.093023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvklv\" (UniqueName: \"kubernetes.io/projected/5417bc96-b4c4-43ce-9e92-ee83800a0884-kube-api-access-xvklv\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:02.097358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.097334    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:02.097466 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.097364    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:02.097466 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.097379    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:02.097466 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.097444    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:02.597429069 +0000 UTC m=+3.049984264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:02.097667 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.097497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlz5b\" (UniqueName: \"kubernetes.io/projected/fa366ece-178c-4273-a045-f47466118b38-kube-api-access-nlz5b\") pod \"node-ca-k2zlh\" (UID: \"fa366ece-178c-4273-a045-f47466118b38\") " pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.106279 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.106233    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal" event={"ID":"6156fb4c23558705bcbe30119a3cfae0","Type":"ContainerStarted","Data":"d4a19e452eb5cf7a52ea0bc68f512e9b4e0ed3bee6c1fe033dc6ba024d6056ef"}
Jul 21 16:25:02.107549 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.107523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal" event={"ID":"18f3f30739cf6a3536e0906fc42f6c19","Type":"ContainerStarted","Data":"20caf2b67a724497c2957541e814926b0a50aa538aec60745cc0e342656493b5"}
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-etc-kubernetes\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-log-socket\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-bin\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-env-overrides\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-systemd-units\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-multus-certs\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-system-cni-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-sys-fs\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np9wd\" (UniqueName: \"kubernetes.io/projected/feedbd1f-f9cc-4f9d-a448-e739330d3b13-kube-api-access-np9wd\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-system-cni-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-systemd-units\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-log-socket\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-etc-kubernetes\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.177417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovn-node-metrics-cert\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-multus\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-sys-fs\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-multus-certs\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-kubelet-config\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-kubelet-config\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-multus\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kz2\" (UniqueName: \"kubernetes.io/projected/e8762e55-e28f-4b17-995d-61980fc1ea69-kube-api-access-c5kz2\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.176996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-node-log\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-dbus\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-daemon-config\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-etc-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/049ea3f7-33c8-404f-8d09-100b99c32868-host-slash\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-cni-binary-copy\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-bin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.178444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-hostroot\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-device-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177246    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-etc-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-netns\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-kubelet\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-slash\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-node-log\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-bin\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-systemd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-dbus\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-cni-bin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-var-lib-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-var-lib-kubelet\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.179324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-slash\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-var-lib-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/049ea3f7-33c8-404f-8d09-100b99c32868-host-slash\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-hostroot\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-conf-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-device-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-conf-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-systemd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-openvswitch\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-netns\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-script-lib\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-cni-binary-copy\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.177873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/049ea3f7-33c8-404f-8d09-100b99c32868-iptables-alerter-script\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.180225 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.177952    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.178008    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:02.677989927 +0000 UTC m=+3.130545129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-daemon-config\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j7k5\" (UniqueName: \"kubernetes.io/projected/049ea3f7-33c8-404f-8d09-100b99c32868-kube-api-access-6j7k5\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-system-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-env-overrides\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-cnibin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-system-cni-dir\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-cnibin\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-socket-dir-parent\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-script-lib\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-k8s-cni-cncf-io\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/049ea3f7-33c8-404f-8d09-100b99c32868-iptables-alerter-script\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-multus-socket-dir-parent\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-os-release\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-netd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-k8s-cni-cncf-io\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.181142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-cni-netd\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-socket-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-os-release\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-kubelet\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-ovn\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-config\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-kubelet\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-registration-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82hq9\" (UniqueName: \"kubernetes.io/projected/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kube-api-access-82hq9\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-run-ovn\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cnibin\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-registration-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97m4p\" (UniqueName: \"kubernetes.io/projected/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-kube-api-access-97m4p\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-os-release\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feedbd1f-f9cc-4f9d-a448-e739330d3b13-cnibin\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-netns\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.178989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-host-run-netns\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.179057    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8762e55-e28f-4b17-995d-61980fc1ea69-os-release\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.179058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-host-run-ovn-kubernetes\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.179163    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/feedbd1f-f9cc-4f9d-a448-e739330d3b13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.179207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-socket-dir\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.179296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovnkube-config\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.182911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.180667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-ovn-node-metrics-cert\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.188729 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.188650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kz2\" (UniqueName: \"kubernetes.io/projected/e8762e55-e28f-4b17-995d-61980fc1ea69-kube-api-access-c5kz2\") pod \"multus-hqrt5\" (UID: \"e8762e55-e28f-4b17-995d-61980fc1ea69\") " pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.192309 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.191398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np9wd\" (UniqueName: \"kubernetes.io/projected/feedbd1f-f9cc-4f9d-a448-e739330d3b13-kube-api-access-np9wd\") pod \"multus-additional-cni-plugins-s4v6t\" (UID: \"feedbd1f-f9cc-4f9d-a448-e739330d3b13\") " pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.192309 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.192054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82hq9\" (UniqueName: \"kubernetes.io/projected/e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e-kube-api-access-82hq9\") pod \"aws-ebs-csi-driver-node-48nx4\" (UID: \"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.193525 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.193469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j7k5\" (UniqueName: \"kubernetes.io/projected/049ea3f7-33c8-404f-8d09-100b99c32868-kube-api-access-6j7k5\") pod \"iptables-alerter-l7mrm\" (UID: \"049ea3f7-33c8-404f-8d09-100b99c32868\") " pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.193962 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.193940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97m4p\" (UniqueName: \"kubernetes.io/projected/0b24ecf0-678c-4dd1-b40f-ed8d470bf799-kube-api-access-97m4p\") pod \"ovnkube-node-sd5wp\" (UID: \"0b24ecf0-678c-4dd1-b40f-ed8d470bf799\") " pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.261592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.261560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2zlh"
Jul 21 16:25:02.269272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.269212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:02.279186 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.279163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r67g2"
Jul 21 16:25:02.280030 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.279931    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa366ece_178c_4273_a045_f47466118b38.slice/crio-959adf13820c7c49b3d14d6f66111eba528092a3bbc651b58afb014856e3a94b WatchSource:0}: Error finding container 959adf13820c7c49b3d14d6f66111eba528092a3bbc651b58afb014856e3a94b: Status 404 returned error can't find the container with id 959adf13820c7c49b3d14d6f66111eba528092a3bbc651b58afb014856e3a94b
Jul 21 16:25:02.282956 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.282921    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22778f0b_691f_44c3_aed6_a3718c617ea9.slice/crio-ade5f529e18bf00f1a91fbcf91f589d5c9ecfecd006af42a10b2a9d75ed50e23 WatchSource:0}: Error finding container ade5f529e18bf00f1a91fbcf91f589d5c9ecfecd006af42a10b2a9d75ed50e23: Status 404 returned error can't find the container with id ade5f529e18bf00f1a91fbcf91f589d5c9ecfecd006af42a10b2a9d75ed50e23
Jul 21 16:25:02.285629 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.285392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgxkf"
Jul 21 16:25:02.289564 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.289490    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01612e69_4f79_48a8_82dc_17af9d14bdbb.slice/crio-9f01ae8315f6fe314d78361b41da0ecaa0cbf67c83d07528192d277cb27dbe56 WatchSource:0}: Error finding container 9f01ae8315f6fe314d78361b41da0ecaa0cbf67c83d07528192d277cb27dbe56: Status 404 returned error can't find the container with id 9f01ae8315f6fe314d78361b41da0ecaa0cbf67c83d07528192d277cb27dbe56
Jul 21 16:25:02.292733 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.292712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l7mrm"
Jul 21 16:25:02.296433 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.296207    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c11abb4_f1f3_4926_ae0d_b7ea4c165a16.slice/crio-16d8e9a9652794bd8236534bcdae7876f0042337ef58c09ffede35615f981231 WatchSource:0}: Error finding container 16d8e9a9652794bd8236534bcdae7876f0042337ef58c09ffede35615f981231: Status 404 returned error can't find the container with id 16d8e9a9652794bd8236534bcdae7876f0042337ef58c09ffede35615f981231
Jul 21 16:25:02.302307 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.302285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4v6t"
Jul 21 16:25:02.303584 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.303560    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049ea3f7_33c8_404f_8d09_100b99c32868.slice/crio-34302e7725e3c8690f29f4d1d02aa721bb84a7fb51fa680c50f7487c7024b0b6 WatchSource:0}: Error finding container 34302e7725e3c8690f29f4d1d02aa721bb84a7fb51fa680c50f7487c7024b0b6: Status 404 returned error can't find the container with id 34302e7725e3c8690f29f4d1d02aa721bb84a7fb51fa680c50f7487c7024b0b6
Jul 21 16:25:02.308769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.308740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqrt5"
Jul 21 16:25:02.314149 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.314126    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeedbd1f_f9cc_4f9d_a448_e739330d3b13.slice/crio-becc5f6fa3d56b76f5bda9f1a521f316f854f26607a373252774dd84c2b95c7b WatchSource:0}: Error finding container becc5f6fa3d56b76f5bda9f1a521f316f854f26607a373252774dd84c2b95c7b: Status 404 returned error can't find the container with id becc5f6fa3d56b76f5bda9f1a521f316f854f26607a373252774dd84c2b95c7b
Jul 21 16:25:02.316343 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.316324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:02.320506 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.320482    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8762e55_e28f_4b17_995d_61980fc1ea69.slice/crio-b6374c5c5cc93dde446cbaee3886bdfbbe570fe48309a2af9d279c73fe15c018 WatchSource:0}: Error finding container b6374c5c5cc93dde446cbaee3886bdfbbe570fe48309a2af9d279c73fe15c018: Status 404 returned error can't find the container with id b6374c5c5cc93dde446cbaee3886bdfbbe570fe48309a2af9d279c73fe15c018
Jul 21 16:25:02.322607 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.322589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4"
Jul 21 16:25:02.329909 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.329880    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b24ecf0_678c_4dd1_b40f_ed8d470bf799.slice/crio-fd98ffc0ce9d866aa127b8306a03076a34ab3068b708df6de0e84f5ae7d98a41 WatchSource:0}: Error finding container fd98ffc0ce9d866aa127b8306a03076a34ab3068b708df6de0e84f5ae7d98a41: Status 404 returned error can't find the container with id fd98ffc0ce9d866aa127b8306a03076a34ab3068b708df6de0e84f5ae7d98a41
Jul 21 16:25:02.336791 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:02.336626    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43aa3b7_8f3f_410a_9e60_e38ef0d3de6e.slice/crio-746837c2306f5161dbfc8aee0b8809b1db182d8f831edad93b4a84e3f530f2ae WatchSource:0}: Error finding container 746837c2306f5161dbfc8aee0b8809b1db182d8f831edad93b4a84e3f530f2ae: Status 404 returned error can't find the container with id 746837c2306f5161dbfc8aee0b8809b1db182d8f831edad93b4a84e3f530f2ae
Jul 21 16:25:02.582933 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.582842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:02.583113 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.583035    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:02.583190 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.583117    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:03.583096215 +0000 UTC m=+4.035651410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:02.683226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.683186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:02.683410 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:02.683235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:02.683410 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683376    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:02.683590 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683412    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:02.683590 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683434    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:02.683590 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683449    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:02.683590 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683456    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:03.683440566 +0000 UTC m=+4.135995763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:02.683590 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:02.683504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:03.683488272 +0000 UTC m=+4.136043467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:03.022201 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.022110    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:20:02 +0000 UTC" deadline="2028-01-09 13:24:38.634470632 +0000 UTC"
Jul 21 16:25:03.022201 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.022149    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h59m35.6123276s"
Jul 21 16:25:03.102086 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.102043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:03.102276 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.102187    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:03.111152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.111120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"fd98ffc0ce9d866aa127b8306a03076a34ab3068b708df6de0e84f5ae7d98a41"}
Jul 21 16:25:03.112697 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.112667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqrt5" event={"ID":"e8762e55-e28f-4b17-995d-61980fc1ea69","Type":"ContainerStarted","Data":"b6374c5c5cc93dde446cbaee3886bdfbbe570fe48309a2af9d279c73fe15c018"}
Jul 21 16:25:03.114097 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.114068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7mrm" event={"ID":"049ea3f7-33c8-404f-8d09-100b99c32868","Type":"ContainerStarted","Data":"34302e7725e3c8690f29f4d1d02aa721bb84a7fb51fa680c50f7487c7024b0b6"}
Jul 21 16:25:03.115403 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.115376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgxkf" event={"ID":"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16","Type":"ContainerStarted","Data":"16d8e9a9652794bd8236534bcdae7876f0042337ef58c09ffede35615f981231"}
Jul 21 16:25:03.116756 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.116696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4" event={"ID":"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e","Type":"ContainerStarted","Data":"746837c2306f5161dbfc8aee0b8809b1db182d8f831edad93b4a84e3f530f2ae"}
Jul 21 16:25:03.120570 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.120535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerStarted","Data":"becc5f6fa3d56b76f5bda9f1a521f316f854f26607a373252774dd84c2b95c7b"}
Jul 21 16:25:03.122618 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.122588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r67g2" event={"ID":"01612e69-4f79-48a8-82dc-17af9d14bdbb","Type":"ContainerStarted","Data":"9f01ae8315f6fe314d78361b41da0ecaa0cbf67c83d07528192d277cb27dbe56"}
Jul 21 16:25:03.124009 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.123973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjw5r" event={"ID":"22778f0b-691f-44c3-aed6-a3718c617ea9","Type":"ContainerStarted","Data":"ade5f529e18bf00f1a91fbcf91f589d5c9ecfecd006af42a10b2a9d75ed50e23"}
Jul 21 16:25:03.125374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.125350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2zlh" event={"ID":"fa366ece-178c-4273-a045-f47466118b38","Type":"ContainerStarted","Data":"959adf13820c7c49b3d14d6f66111eba528092a3bbc651b58afb014856e3a94b"}
Jul 21 16:25:03.593120 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.592493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:03.593120 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.592647    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:03.593120 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.592738    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.592715021 +0000 UTC m=+6.045270217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.693248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:03.693304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.693496    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.693520    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.693536    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:03.693876 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.693599    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.693578673 +0000 UTC m=+6.146133890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:03.694363 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.694006    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:03.694363 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:03.694054    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.694037239 +0000 UTC m=+6.146592431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:04.023186 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:04.023049    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:20:02 +0000 UTC" deadline="2028-02-06 20:05:27.553052632 +0000 UTC"
Jul 21 16:25:04.023186 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:04.023141    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13563h40m23.529915999s"
Jul 21 16:25:04.102543 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:04.102513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:04.102716 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:04.102658    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:04.103462 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:04.103249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:04.103462 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:04.103421    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:05.101919 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.101659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:05.102397 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.102044    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:05.139884 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.139176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal" event={"ID":"18f3f30739cf6a3536e0906fc42f6c19","Type":"ContainerStarted","Data":"cff8cfb9b500cc3b52f484dc9a0592717c0e05c95e1b8cb1fcf6ff1eb8d7a996"}
Jul 21 16:25:05.144134 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.143565    2577 generic.go:356] "Generic (PLEG): container finished" podID="6156fb4c23558705bcbe30119a3cfae0" containerID="57692f22db3c2a0db4c1e2cd6a4f39d0f319bd0c19832742eabdb92dfaa49bf4" exitCode=0
Jul 21 16:25:05.144134 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.143614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal" event={"ID":"6156fb4c23558705bcbe30119a3cfae0","Type":"ContainerDied","Data":"57692f22db3c2a0db4c1e2cd6a4f39d0f319bd0c19832742eabdb92dfaa49bf4"}
Jul 21 16:25:05.159433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.159257    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-38.ec2.internal" podStartSLOduration=4.159237322 podStartE2EDuration="4.159237322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:05.159223088 +0000 UTC m=+5.611778306" watchObservedRunningTime="2026-07-21 16:25:05.159237322 +0000 UTC m=+5.611792540"
Jul 21 16:25:05.612502 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.612409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:05.612676 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.612604    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.612676 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.612674    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:09.612654014 +0000 UTC m=+10.065209220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.713296 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.713255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:05.713505 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:05.713317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:05.713583 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.713505    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:05.713583 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.713528    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:05.713583 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.713541    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.713726 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.713599    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:09.713581053 +0000 UTC m=+10.166136248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.714037 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.714015    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:05.714117 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:05.714078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:09.714062395 +0000 UTC m=+10.166617593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:06.104583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:06.103809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:06.104583 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:06.103944    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:06.104583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:06.104302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:06.104583 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:06.104419    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:07.102647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:07.102438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:07.102647 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:07.102598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:08.102719 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:08.102624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:08.103172 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:08.102765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:08.103172 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:08.102627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:08.103302 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:08.103236    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:09.101563 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:09.101531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:09.101748 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.101683    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:09.648154 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:09.648118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:09.648639 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.648281    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:09.648639 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.648380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.648347762 +0000 UTC m=+18.100902969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:09.748765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:09.748821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.748968    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.748986    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.748999    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.749052    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.749034602 +0000 UTC m=+18.201589799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.749297    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:09.749358 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:09.749374    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:17.749356408 +0000 UTC m=+18.201911613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:10.102359 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:10.102264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:10.102508 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:10.102392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:10.102508 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:10.102478    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:10.102628 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:10.102530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:11.101825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:11.101739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:11.102265 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:11.101903    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:12.102564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:12.102058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:12.102564 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:12.102199    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:12.102564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:12.102265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:12.102564 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:12.102454    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:13.102191 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:13.102154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:13.102386 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:13.102300    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:14.102090 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:14.102011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:14.102537 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:14.102148    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:14.102537 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:14.102210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:14.102537 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:14.102340    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:15.101923 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:15.101887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:15.102074 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:15.102005    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:16.101900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:16.101858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:16.102288 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:16.101998    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:16.102288 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:16.102045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:16.102288 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:16.102161    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:17.101436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:17.101402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:17.101649 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.101545    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:17.709178 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:17.709140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:17.709615 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.709304    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:17.709615 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.709393    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:33.709372683 +0000 UTC m=+34.161927884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:17.810250 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:17.810217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:17.810442 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:17.810262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:17.810442 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810395    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:17.810442 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810417    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:17.810442 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810434    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:17.810442 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810446    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:17.810689 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810466    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:33.810445144 +0000 UTC m=+34.263000334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:17.810689 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:17.810493    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:33.810477128 +0000 UTC m=+34.263032334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:18.101551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:18.101459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:18.101551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:18.101510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:18.101760 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:18.101576    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:18.101760 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:18.101711    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:19.101460 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:19.101425    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:19.101909 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:19.101539    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:20.102297 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:20.102256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:20.102810 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:20.102388    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:20.102810 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:20.102456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:20.102810 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:20.102564    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:21.101676 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:21.101644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:21.101833 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:21.101751    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:22.102432 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.102045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:22.103267 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.102088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:22.103267 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:22.102701    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:22.103267 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:22.103225    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:22.176404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.176376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjw5r" event={"ID":"22778f0b-691f-44c3-aed6-a3718c617ea9","Type":"ContainerStarted","Data":"70c2326077ee9c3996c9e0da7f882a719ba5a2c1afbbac85b3f1e8f84baf5178"}
Jul 21 16:25:22.177675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.177651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2zlh" event={"ID":"fa366ece-178c-4273-a045-f47466118b38","Type":"ContainerStarted","Data":"f6d035a08e40f729a6608e1d81377dc7e567c951c4f317ad6fcbf024ce92ce78"}
Jul 21 16:25:22.179539 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.179515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"3823f3715e0e68b4b9fa27bfb48552bf465df59e1ff00274a1911dd31d454ca4"}
Jul 21 16:25:22.179640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.179588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"9fe8334baa9ccb7cef486f9c1ecb2526bbd271461ce38b32b5bf57390c72d3a2"}
Jul 21 16:25:22.179696 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.179638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"8432acf1807a3d1c93ef0894a2240011315b65f7e192421de58a4004772f685a"}
Jul 21 16:25:22.180884 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.180860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqrt5" event={"ID":"e8762e55-e28f-4b17-995d-61980fc1ea69","Type":"ContainerStarted","Data":"5be11c147f4ae01ccb5088d362deb04b5225f742ef122fdc9711315d97f42d3f"}
Jul 21 16:25:22.182051 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.182021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgxkf" event={"ID":"4c11abb4-f1f3-4926-ae0d-b7ea4c165a16","Type":"ContainerStarted","Data":"60bad3ecfaf4b69281b27f5e602ee32bda7f5a81e90234c0d6e1489056516b42"}
Jul 21 16:25:22.183633 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.183612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal" event={"ID":"6156fb4c23558705bcbe30119a3cfae0","Type":"ContainerStarted","Data":"5caed1781cbafd1804729cbdf63c19e1ee7835e5f995c83a5c43fb070fad7773"}
Jul 21 16:25:22.184863 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.184846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4" event={"ID":"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e","Type":"ContainerStarted","Data":"ede0125b8308b0c8ffd20482f6a390e7706a7c50d0007bdeee68f3700946ac7b"}
Jul 21 16:25:22.186137 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.186117    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="9f36999c345e090a4e39e99bca1ca0ffd1cca1eda89bdec93a60ba77e9b62ba0" exitCode=0
Jul 21 16:25:22.186276 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.186173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"9f36999c345e090a4e39e99bca1ca0ffd1cca1eda89bdec93a60ba77e9b62ba0"}
Jul 21 16:25:22.187584 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.187566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r67g2" event={"ID":"01612e69-4f79-48a8-82dc-17af9d14bdbb","Type":"ContainerStarted","Data":"f64c35f9c52804a01aeeff535be73391f7bdbf3a857ca77b7d27292483d4b426"}
Jul 21 16:25:22.191459 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.191425    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjw5r" podStartSLOduration=2.783522209 podStartE2EDuration="22.191414097s" totalImagesPullingTime="19.407891888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.19125284 +0000 UTC m=+22.643808283" watchObservedRunningTime="2026-07-21 16:25:22.191414097 +0000 UTC m=+22.643969309"
Jul 21 16:25:22.205815 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.205781    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-38.ec2.internal" podStartSLOduration=21.205770322 podStartE2EDuration="21.205770322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.20569237 +0000 UTC m=+22.658247582" watchObservedRunningTime="2026-07-21 16:25:22.205770322 +0000 UTC m=+22.658325532"
Jul 21 16:25:22.221552 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.221518    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r67g2" podStartSLOduration=2.819202497 podStartE2EDuration="22.221509403s" totalImagesPullingTime="19.402306906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.221241947 +0000 UTC m=+22.673797159" watchObservedRunningTime="2026-07-21 16:25:22.221509403 +0000 UTC m=+22.674064614"
Jul 21 16:25:22.258883 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.258846    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k2zlh" podStartSLOduration=2.848885201 podStartE2EDuration="22.258835018s" totalImagesPullingTime="19.409949817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.258513134 +0000 UTC m=+22.711068346" watchObservedRunningTime="2026-07-21 16:25:22.258835018 +0000 UTC m=+22.711390230"
Jul 21 16:25:22.275054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:22.275024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgxkf" podStartSLOduration=2.879638485 podStartE2EDuration="22.275014229s" totalImagesPullingTime="19.395375744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.274909146 +0000 UTC m=+22.727464357" watchObservedRunningTime="2026-07-21 16:25:22.275014229 +0000 UTC m=+22.727569441"
Jul 21 16:25:23.102166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.102096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:23.102326 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:23.102220    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:23.190513 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.190484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l7mrm" event={"ID":"049ea3f7-33c8-404f-8d09-100b99c32868","Type":"ContainerStarted","Data":"082e87cd4c19c39e0ebfcdac49ba16e6e997f6c4b91a63a483eda8d1ac9a3c4a"}
Jul 21 16:25:23.193343 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.193303    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"48fbc38da84516c962d2ba6fea5a86f4cb22a78a20a3d3f49aa7aaa0268b28b1"}
Jul 21 16:25:23.193443 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.193389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"a0afe06d0b26e2378819f190a9f69ff8b61a7c19ee24580b5694d93a9fdf30e8"}
Jul 21 16:25:23.193770 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.193749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"a8318e78d6c1ced5daa7c06057cdf21892dfb16c1d15e082275e93566fe817ac"}
Jul 21 16:25:23.212937 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.212901    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hqrt5" podStartSLOduration=3.7744666110000002 podStartE2EDuration="23.212888222s" totalImagesPullingTime="19.438421611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:22.296002129 +0000 UTC m=+22.748557341" watchObservedRunningTime="2026-07-21 16:25:23.212888222 +0000 UTC m=+23.665443434"
Jul 21 16:25:23.213242 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.213213    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l7mrm" podStartSLOduration=3.822046982 podStartE2EDuration="23.213204982s" totalImagesPullingTime="19.391158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:23.212587795 +0000 UTC m=+23.665143010" watchObservedRunningTime="2026-07-21 16:25:23.213204982 +0000 UTC m=+23.665760196"
Jul 21 16:25:23.367753 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.367725    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:25:23.663187 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.663106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:23.803482 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.803439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:23.932676 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:23.932547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:24.019013 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.018981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:24.038208 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.038103    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:25:23.367749931Z","UUID":"6afd463e-6165-4333-b415-f82396bbf442","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:25:24.039529 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.039510    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:25:24.039623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.039552    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:25:24.097580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.097556    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:24.098049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.098032    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:24.101804 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.101786    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:24.101952 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:24.101872    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:24.101952 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.101919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:24.102056 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:24.102007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:24.198492 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.198369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4" event={"ID":"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e","Type":"ContainerStarted","Data":"f1bd88aa9244da6d0130cc66b91ffa543e8cbfc6720a309bf7bbb886acbf7504"}
Jul 21 16:25:24.198901 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.198672    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:24.199036 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.199018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjw5r"
Jul 21 16:25:24.275112 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:24.275071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:25.102202 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:25.102175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:25.102369 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:25.102276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:25.202738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:25.202702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4" event={"ID":"e43aa3b7-8f3f-410a-9e60-e38ef0d3de6e","Type":"ContainerStarted","Data":"63011f00235b4d8d9b8772214e0d6cdae7b92ad991941d1a267f6851eb5b01b0"}
Jul 21 16:25:25.205997 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:25.205976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"b3b12cda285ed061203e02fda85029903ae85c25e21ccfc59be069716498a4f9"}
Jul 21 16:25:25.230411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:25.230372    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-48nx4" podStartSLOduration=2.589809226 podStartE2EDuration="24.230360151s" totalImagesPullingTime="21.640550925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:25.230124928 +0000 UTC m=+25.682680141" watchObservedRunningTime="2026-07-21 16:25:25.230360151 +0000 UTC m=+25.682915362"
Jul 21 16:25:26.102600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.102355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:26.102772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.102381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:26.102772 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:26.102712    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:26.102878 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:26.102811    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:26.484672 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.484576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:26.560453 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.560397    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:26.620078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.620040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:26.935601 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.935531    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:26.991228 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:26.991150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:27.102001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.101980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:27.102093 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:27.102077    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:27.212896 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.212868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" event={"ID":"0b24ecf0-678c-4dd1-b40f-ed8d470bf799","Type":"ContainerStarted","Data":"9cf7802bd8ffdc3f59dfe1f8f5d00ed2585a6c3a3c9fa2daa09247fd2c4a2d5a"}
Jul 21 16:25:27.213096 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.213069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:27.213188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.213151    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:27.227378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.227359    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:27.284700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.284613    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp" podStartSLOduration=7.860143895 podStartE2EDuration="27.284593289s" totalImagesPullingTime="19.424449394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:27.243771949 +0000 UTC m=+27.696327161" watchObservedRunningTime="2026-07-21 16:25:27.284593289 +0000 UTC m=+27.737148502"
Jul 21 16:25:27.562614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.562591    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:27.663036 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.662881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:27.766038 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.766008    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:27.819431 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.819365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:27.968851 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:27.968813    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:28.025989 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.025955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:28.104841 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.104779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:28.104986 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.104779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:28.104986 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:28.104881    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:28.104986 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:28.104970    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:28.216777 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.216746    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="842aeafbba3879e538e39b8b5e32eebae1ffae3f49250b5fc9d266de176f2818" exitCode=0
Jul 21 16:25:28.216965 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.216834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"842aeafbba3879e538e39b8b5e32eebae1ffae3f49250b5fc9d266de176f2818"}
Jul 21 16:25:28.217932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.217463    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:28.233195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.233175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:25:28.622923 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.622898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:28.708268 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.708234    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:28.767193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:28.767155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:29.102088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.102062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:29.102255 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:29.102163    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:29.105993 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.105961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dtfj"]
Jul 21 16:25:29.109557 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.109534    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svgc8"]
Jul 21 16:25:29.109663 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.109616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:29.109720 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:29.109702    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:29.110121 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.110097    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55rwx"]
Jul 21 16:25:29.110222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.110165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:29.110268 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:29.110235    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:29.113175 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.113151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:29.170597 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.170541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:29.218534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:29.218514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:29.218629 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:29.218614    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:30.222615 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:30.222580    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="24d4f3855d40a67c8d3baf56cbcd1c84fcf2e03b8e3fb3e84da71a10c3fe0cc0" exitCode=0
Jul 21 16:25:30.223007 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:30.222669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"24d4f3855d40a67c8d3baf56cbcd1c84fcf2e03b8e3fb3e84da71a10c3fe0cc0"}
Jul 21 16:25:31.102222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:31.102143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:31.102222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:31.102164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:31.102222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:31.102160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:31.102523 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:31.102275    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:31.102523 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:31.102385    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:31.102523 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:31.102440    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:32.231297 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:32.231111    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="06369797d170e230bb7f783e4eae2914de39ad1c4b475dac50756f04841e0891" exitCode=0
Jul 21 16:25:32.231643 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:32.231201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"06369797d170e230bb7f783e4eae2914de39ad1c4b475dac50756f04841e0891"}
Jul 21 16:25:33.102404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.102362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:33.102554 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.102360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:33.102554 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.102490    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55rwx" podUID="f49d953a-8e68-41d4-90bc-dcb7b1e2e778"
Jul 21 16:25:33.102554 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.102547    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-svgc8" podUID="e440a4bb-887d-4f5b-9e5f-71f80b1fc597"
Jul 21 16:25:33.102729 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.102378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:33.102729 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.102638    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dtfj" podUID="5417bc96-b4c4-43ce-9e92-ee83800a0884"
Jul 21 16:25:33.735299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.735267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:33.735773 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.735409    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:33.735773 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.735465    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs podName:5417bc96-b4c4-43ce-9e92-ee83800a0884 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:05.735450943 +0000 UTC m=+66.188006133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs") pod "network-metrics-daemon-6dtfj" (UID: "5417bc96-b4c4-43ce-9e92-ee83800a0884") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:33.836607 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.836569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:33.836607 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:33.836614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836729    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836790    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret podName:f49d953a-8e68-41d4-90bc-dcb7b1e2e778 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:05.83677449 +0000 UTC m=+66.289329680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret") pod "global-pull-secret-syncer-55rwx" (UID: "f49d953a-8e68-41d4-90bc-dcb7b1e2e778") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836736    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836844    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836858    2577 projected.go:196] Error preparing data for projected volume kube-api-access-vmj7b for pod openshift-network-diagnostics/network-check-target-svgc8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:33.836926 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:33.836904    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b podName:e440a4bb-887d-4f5b-9e5f-71f80b1fc597 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:05.836889966 +0000 UTC m=+66.289445170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmj7b" (UniqueName: "kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b") pod "network-check-target-svgc8" (UID: "e440a4bb-887d-4f5b-9e5f-71f80b1fc597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:34.330774 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.330749    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-38.ec2.internal" event="NodeReady"
Jul 21 16:25:34.330958 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.330895    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:25:34.374541 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.374510    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:25:34.376724 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.376552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.379829 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.379803    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:25:34.380122 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.380105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-74hb8\""
Jul 21 16:25:34.380678 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.380655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:25:34.380781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.380740    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:25:34.387027 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.387009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:25:34.387655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.387416    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6n7m7"]
Jul 21 16:25:34.390739 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.390610    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8p9zm"]
Jul 21 16:25:34.392076 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.390945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.392782 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.392763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:25:34.392874 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.392839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.393640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.393605    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:25:34.395577 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395553    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:25:34.395675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395605    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:25:34.395732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395563    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:25:34.395806 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395789    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kw8jm\""
Jul 21 16:25:34.395916 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:25:34.396078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.395935    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z2m2\""
Jul 21 16:25:34.402413 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.402064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8p9zm"]
Jul 21 16:25:34.402766 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.402747    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6n7m7"]
Jul 21 16:25:34.529289 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.529218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:34.541220 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-config-volume\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.541377 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541377 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-tmp-dir\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.541377 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884vl\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5p5h\" (UniqueName: \"kubernetes.io/projected/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-kube-api-access-f5p5h\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts98d\" (UniqueName: \"kubernetes.io/projected/2101ea20-cb8e-45dc-8552-113f1a586200-kube-api-access-ts98d\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.541532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2101ea20-cb8e-45dc-8552-113f1a586200-cert\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.541738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.541738 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.541595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.592570 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.592535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:34.642417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642571 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642641 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-config-volume\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.642711 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-tmp-dir\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.642820 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642872 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642872 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:34.642836    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:34.642872 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884vl\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.642872 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:34.642856    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6796d45784-bjp2c: secret "image-registry-tls" not found
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5p5h\" (UniqueName: \"kubernetes.io/projected/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-kube-api-access-f5p5h\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:34.642927    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls podName:4880c6fc-1273-44fb-a9fb-d2d30e230a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:25:35.142907675 +0000 UTC m=+35.595462885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls") pod "image-registry-6796d45784-bjp2c" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e") : secret "image-registry-tls" not found
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts98d\" (UniqueName: \"kubernetes.io/projected/2101ea20-cb8e-45dc-8552-113f1a586200-kube-api-access-ts98d\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2101ea20-cb8e-45dc-8552-113f1a586200-cert\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.643067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.642820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-config-volume\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:34.643516    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:34.643579    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls podName:36259e17-91b0-4fd1-b01a-bc5e0b2efe99 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:35.143562405 +0000 UTC m=+35.596117596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls") pod "dns-default-6n7m7" (UID: "36259e17-91b0-4fd1-b01a-bc5e0b2efe99") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-tmp-dir\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.643700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.643676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.647607 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.647583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.647708 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.647613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.647708 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.647659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2101ea20-cb8e-45dc-8552-113f1a586200-cert\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.652526 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.652456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5p5h\" (UniqueName: \"kubernetes.io/projected/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-kube-api-access-f5p5h\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:34.652526 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.652475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.652782 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.652759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-884vl\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:34.653053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.653036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts98d\" (UniqueName: \"kubernetes.io/projected/2101ea20-cb8e-45dc-8552-113f1a586200-kube-api-access-ts98d\") pod \"ingress-canary-8p9zm\" (UID: \"2101ea20-cb8e-45dc-8552-113f1a586200\") " pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.710197 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.710164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8p9zm"
Jul 21 16:25:34.850214 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:34.850186    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8p9zm"]
Jul 21 16:25:34.854787 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:34.854760    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2101ea20_cb8e_45dc_8552_113f1a586200.slice/crio-4fa2c0189336e3ff37faa48c5c626f9104e98fa4a9059cc42f7f1c33a7c51133 WatchSource:0}: Error finding container 4fa2c0189336e3ff37faa48c5c626f9104e98fa4a9059cc42f7f1c33a7c51133: Status 404 returned error can't find the container with id 4fa2c0189336e3ff37faa48c5c626f9104e98fa4a9059cc42f7f1c33a7c51133
Jul 21 16:25:35.102046 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.101960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:25:35.102205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.102070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:25:35.102205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.102167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:25:35.106865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106730    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:25:35.106865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106782    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:25:35.106865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crp4d\""
Jul 21 16:25:35.106865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:25:35.107145 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106989    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:25:35.107145 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.106994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrbdq\""
Jul 21 16:25:35.147797 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.147768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:35.147887 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.147838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:35.147938 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:35.147920    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:35.147984 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:35.147942    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6796d45784-bjp2c: secret "image-registry-tls" not found
Jul 21 16:25:35.147984 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:35.147951    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:35.148060 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:35.148000    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls podName:4880c6fc-1273-44fb-a9fb-d2d30e230a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:25:36.147979521 +0000 UTC m=+36.600534725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls") pod "image-registry-6796d45784-bjp2c" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e") : secret "image-registry-tls" not found
Jul 21 16:25:35.148060 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:35.148014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls podName:36259e17-91b0-4fd1-b01a-bc5e0b2efe99 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:36.148008041 +0000 UTC m=+36.600563230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls") pod "dns-default-6n7m7" (UID: "36259e17-91b0-4fd1-b01a-bc5e0b2efe99") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:35.238929 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.238895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8p9zm" event={"ID":"2101ea20-cb8e-45dc-8552-113f1a586200","Type":"ContainerStarted","Data":"4fa2c0189336e3ff37faa48c5c626f9104e98fa4a9059cc42f7f1c33a7c51133"}
Jul 21 16:25:35.931014 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:35.930811    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:36.156920 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.156881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:36.157106 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.156960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:36.157180 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.157120    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:36.157231 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.157181    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls podName:36259e17-91b0-4fd1-b01a-bc5e0b2efe99 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:38.157162841 +0000 UTC m=+38.609718031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls") pod "dns-default-6n7m7" (UID: "36259e17-91b0-4fd1-b01a-bc5e0b2efe99") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:36.157231 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.157124    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:36.157352 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.157261    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6796d45784-bjp2c: secret "image-registry-tls" not found
Jul 21 16:25:36.157352 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.157348    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls podName:4880c6fc-1273-44fb-a9fb-d2d30e230a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:25:38.157331684 +0000 UTC m=+38.609886887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls") pod "image-registry-6796d45784-bjp2c" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e") : secret "image-registry-tls" not found
Jul 21 16:25:36.512201 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.512170    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jsxs2"]
Jul 21 16:25:36.514759 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.514724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.518162 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.517828    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:25:36.518162 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.517926    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:25:36.518162 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.517946    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:25:36.518162 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.517971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7w2v\""
Jul 21 16:25:36.519573 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.519377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:25:36.529259 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.529235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jsxs2"]
Jul 21 16:25:36.549817 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.549786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:36.651182 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.651144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:36.661999 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.661975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.662138 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.662028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e689d56-e7a2-4563-9968-e8d65f018382-data-volume\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.662138 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.662114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e689d56-e7a2-4563-9968-e8d65f018382-crio-socket\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.662256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.662152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.662256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.662170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnfr\" (UniqueName: \"kubernetes.io/projected/0e689d56-e7a2-4563-9968-e8d65f018382-kube-api-access-6qnfr\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763448 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e689d56-e7a2-4563-9968-e8d65f018382-data-volume\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763448 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e689d56-e7a2-4563-9968-e8d65f018382-crio-socket\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnfr\" (UniqueName: \"kubernetes.io/projected/0e689d56-e7a2-4563-9968-e8d65f018382-kube-api-access-6qnfr\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763665 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.763583    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:25:36.763873 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.763675    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:37.263653584 +0000 UTC m=+37.716208781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : configmap "kube-rbac-proxy" not found
Jul 21 16:25:36.763873 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.763682    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:36.763873 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e689d56-e7a2-4563-9968-e8d65f018382-crio-socket\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763873 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.763714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e689d56-e7a2-4563-9968-e8d65f018382-data-volume\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.763873 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:36.763734    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:37.263723715 +0000 UTC m=+37.716278905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:36.778080 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.778052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnfr\" (UniqueName: \"kubernetes.io/projected/0e689d56-e7a2-4563-9968-e8d65f018382-kube-api-access-6qnfr\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:36.883571 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.883542    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:36.904873 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.904845    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"]
Jul 21 16:25:36.906952 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.906935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"
Jul 21 16:25:36.911444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.911414    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qkx8m\""
Jul 21 16:25:36.911572 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.911541    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 16:25:36.911645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.911594    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 16:25:36.924150 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.924094    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"]
Jul 21 16:25:36.997192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:36.997140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:37.065487 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.065404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5f2b\" (UniqueName: \"kubernetes.io/projected/ca75bd3f-791b-412e-825a-07e9fbf1f8fa-kube-api-access-h5f2b\") pod \"migrator-7cc9c7ffd7-rnsgl\" (UID: \"ca75bd3f-791b-412e-825a-07e9fbf1f8fa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"
Jul 21 16:25:37.097143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.097093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:37.166486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.166450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5f2b\" (UniqueName: \"kubernetes.io/projected/ca75bd3f-791b-412e-825a-07e9fbf1f8fa-kube-api-access-h5f2b\") pod \"migrator-7cc9c7ffd7-rnsgl\" (UID: \"ca75bd3f-791b-412e-825a-07e9fbf1f8fa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"
Jul 21 16:25:37.182705 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.182681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5f2b\" (UniqueName: \"kubernetes.io/projected/ca75bd3f-791b-412e-825a-07e9fbf1f8fa-kube-api-access-h5f2b\") pod \"migrator-7cc9c7ffd7-rnsgl\" (UID: \"ca75bd3f-791b-412e-825a-07e9fbf1f8fa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"
Jul 21 16:25:37.197279 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.197253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:37.216779 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.216755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"
Jul 21 16:25:37.266890 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.266849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:37.267047 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:37.266980    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 16:25:37.267047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.267020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:37.267047 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:37.267049    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:38.267027852 +0000 UTC m=+38.719583051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : configmap "kube-rbac-proxy" not found
Jul 21 16:25:37.267221 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:37.267126    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:37.267221 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:37.267199    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:38.267182653 +0000 UTC m=+38.719737906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:37.612859 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.612825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:37.715634 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.715595    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:37.856144 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.856120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl"]
Jul 21 16:25:37.860186 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:37.860143    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca75bd3f_791b_412e_825a_07e9fbf1f8fa.slice/crio-f0b387f7949d6a0915f3fa039cd64f6696e4d966042a0bfe4dddf87e219e08cd WatchSource:0}: Error finding container f0b387f7949d6a0915f3fa039cd64f6696e4d966042a0bfe4dddf87e219e08cd: Status 404 returned error can't find the container with id f0b387f7949d6a0915f3fa039cd64f6696e4d966042a0bfe4dddf87e219e08cd
Jul 21 16:25:37.929677 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.929468    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgxkf_4c11abb4-f1f3-4926-ae0d-b7ea4c165a16/dns-node-resolver/0.log"
Jul 21 16:25:37.936381 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:37.936298    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:38.035028 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.034993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:38.174544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.174469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:38.174685 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.174634    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:38.174685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.174671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:38.174771 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.174694    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls podName:36259e17-91b0-4fd1-b01a-bc5e0b2efe99 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:42.174676 +0000 UTC m=+42.627231198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls") pod "dns-default-6n7m7" (UID: "36259e17-91b0-4fd1-b01a-bc5e0b2efe99") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:38.174771 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.174743    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:38.174771 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.174756    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6796d45784-bjp2c: secret "image-registry-tls" not found
Jul 21 16:25:38.174912 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.174794    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls podName:4880c6fc-1273-44fb-a9fb-d2d30e230a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:25:42.17478135 +0000 UTC m=+42.627336540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls") pod "image-registry-6796d45784-bjp2c" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e") : secret "image-registry-tls" not found
Jul 21 16:25:38.247961 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.247931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8p9zm" event={"ID":"2101ea20-cb8e-45dc-8552-113f1a586200","Type":"ContainerStarted","Data":"0701f4221a6ab93735f7e7850d95fb20ff765c003e96eec15de9d9ffffffefc3"}
Jul 21 16:25:38.248996 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.248971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl" event={"ID":"ca75bd3f-791b-412e-825a-07e9fbf1f8fa","Type":"ContainerStarted","Data":"f0b387f7949d6a0915f3fa039cd64f6696e4d966042a0bfe4dddf87e219e08cd"}
Jul 21 16:25:38.251668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.251646    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="dfb15a921563a3c6c4296e5c01dcf8affeb990c4f0644b5a746d9f404a4db08e" exitCode=0
Jul 21 16:25:38.251783 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.251677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"dfb15a921563a3c6c4296e5c01dcf8affeb990c4f0644b5a746d9f404a4db08e"}
Jul 21 16:25:38.271231 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.271197    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8p9zm" podStartSLOduration=1.407518289 podStartE2EDuration="4.271184182s" totalImagesPullingTime="2.863665893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:38.27017671 +0000 UTC m=+38.722731916" watchObservedRunningTime="2026-07-21 16:25:38.271184182 +0000 UTC m=+38.723739394"
Jul 21 16:25:38.275244 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.275228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:38.275321 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.275293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:38.275414 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.275395    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:38.275473 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:38.275462    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:40.275444951 +0000 UTC m=+40.728000155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:38.275833 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.275818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e689d56-e7a2-4563-9968-e8d65f018382-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:38.341008 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.340967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:38.914891 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.914843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:38.982684 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:38.982651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.119035 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.119000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.225587 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.225507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.256805 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.256779    2577 generic.go:356] "Generic (PLEG): container finished" podID="feedbd1f-f9cc-4f9d-a448-e739330d3b13" containerID="009e1da97280b00233a19072530a409ffaadfb197fae0b994d6474950a451e68" exitCode=0
Jul 21 16:25:39.256944 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.256867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerDied","Data":"009e1da97280b00233a19072530a409ffaadfb197fae0b994d6474950a451e68"}
Jul 21 16:25:39.295457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.295439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2zlh_fa366ece-178c-4273-a045-f47466118b38/node-ca/0.log"
Jul 21 16:25:39.332660 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.332632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.515911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.515842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.587694 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.587672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:39.905662 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:39.905630    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8p9zm_2101ea20-cb8e-45dc-8552-113f1a586200/serve-healthcheck-canary/0.log"
Jul 21 16:25:40.260811 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.260773    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl" event={"ID":"ca75bd3f-791b-412e-825a-07e9fbf1f8fa","Type":"ContainerStarted","Data":"7f7dc840bd2c69b402da3baaba93352a654e20fc0a53cdcb6772cb79063a5151"}
Jul 21 16:25:40.261236 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.260842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl" event={"ID":"ca75bd3f-791b-412e-825a-07e9fbf1f8fa","Type":"ContainerStarted","Data":"644f8a25b28e9f60792a9a2b615b082f8e4a599852704ae2ca0b9431ba2d6643"}
Jul 21 16:25:40.263814 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.263791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" event={"ID":"feedbd1f-f9cc-4f9d-a448-e739330d3b13","Type":"ContainerStarted","Data":"c14d4a2f6821a8115c69f61bce10c5673979d18c9bd87081597ec8eab629d185"}
Jul 21 16:25:40.290995 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.290974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:40.291134 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:40.291115    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:40.291198 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:40.291181    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:44.291161409 +0000 UTC m=+44.743716606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:40.296195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.296161    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-rnsgl" podStartSLOduration=2.541002636 podStartE2EDuration="4.296147792s" totalImagesPullingTime="1.755145156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:40.295809861 +0000 UTC m=+40.748365072" watchObservedRunningTime="2026-07-21 16:25:40.296147792 +0000 UTC m=+40.748702982"
Jul 21 16:25:40.332784 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.332746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s4v6t" podStartSLOduration=8.351639152 podStartE2EDuration="40.332734351s" totalImagesPullingTime="31.981095199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:40.332084447 +0000 UTC m=+40.784639661" watchObservedRunningTime="2026-07-21 16:25:40.332734351 +0000 UTC m=+40.785289562"
Jul 21 16:25:40.495819 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.495792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:40.697739 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.697711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:40.810933 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:40.810901    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:41.184255 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:41.184219    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:42.204291 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:42.204256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:42.204336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:42.204447    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:42.204461    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:42.204478    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6796d45784-bjp2c: secret "image-registry-tls" not found
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:42.204498    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls podName:36259e17-91b0-4fd1-b01a-bc5e0b2efe99 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:50.204484631 +0000 UTC m=+50.657039822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls") pod "dns-default-6n7m7" (UID: "36259e17-91b0-4fd1-b01a-bc5e0b2efe99") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:42.204673 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:42.204518    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls podName:4880c6fc-1273-44fb-a9fb-d2d30e230a3e nodeName:}" failed. No retries permitted until 2026-07-21 16:25:50.204504746 +0000 UTC m=+50.657059935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls") pod "image-registry-6796d45784-bjp2c" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e") : secret "image-registry-tls" not found
Jul 21 16:25:42.726378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:42.726332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:42.795413 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:42.795380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:44.320189 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:44.320158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:44.320588 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:44.320300    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:44.320588 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:25:44.320374    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls podName:0e689d56-e7a2-4563-9968-e8d65f018382 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:52.320357169 +0000 UTC m=+52.772912359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jsxs2" (UID: "0e689d56-e7a2-4563-9968-e8d65f018382") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:45.653745 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:45.653712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:45.951021 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:45.950915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:46.251846 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:46.251765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:46.354697 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:46.354661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:46.461105 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:46.461071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:46.644399 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:46.644374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:47.644719 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:47.644690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:48.042533 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:48.042439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:48.243171 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:48.243141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:48.443375 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:48.443333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:48.647674 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:48.647644    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:49.573039 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:49.573011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:49.673386 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:49.673360    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:49.737933 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:49.737904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:50.045003 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.044965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:50.240430 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.240396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:50.264160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.264134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:50.264264 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.264187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:50.267428 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.267405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36259e17-91b0-4fd1-b01a-bc5e0b2efe99-metrics-tls\") pod \"dns-default-6n7m7\" (UID: \"36259e17-91b0-4fd1-b01a-bc5e0b2efe99\") " pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:50.267541 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.267506    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"image-registry-6796d45784-bjp2c\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") " pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:50.287734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.287715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:50.302701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.302683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:50.442601 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.442567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:50.449936 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.449915    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:25:50.458532 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:50.458508    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4880c6fc_1273_44fb_a9fb_d2d30e230a3e.slice/crio-16b68e634540905a1992daa58ef6a524b6a03d762010f8480151ec4150ebb525 WatchSource:0}: Error finding container 16b68e634540905a1992daa58ef6a524b6a03d762010f8480151ec4150ebb525: Status 404 returned error can't find the container with id 16b68e634540905a1992daa58ef6a524b6a03d762010f8480151ec4150ebb525
Jul 21 16:25:50.466181 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.466159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6n7m7"]
Jul 21 16:25:50.468721 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:50.468702    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36259e17_91b0_4fd1_b01a_bc5e0b2efe99.slice/crio-fb23e0c8e76ba613ef08d1be9f2d83969c6c206adbcb7cd3d2ef78ce9d6de928 WatchSource:0}: Error finding container fb23e0c8e76ba613ef08d1be9f2d83969c6c206adbcb7cd3d2ef78ce9d6de928: Status 404 returned error can't find the container with id fb23e0c8e76ba613ef08d1be9f2d83969c6c206adbcb7cd3d2ef78ce9d6de928
Jul 21 16:25:50.543241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.543211    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:50.847180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:50.847152    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.291161 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.291123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" event={"ID":"4880c6fc-1273-44fb-a9fb-d2d30e230a3e","Type":"ContainerStarted","Data":"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"}
Jul 21 16:25:51.291363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.291228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" event={"ID":"4880c6fc-1273-44fb-a9fb-d2d30e230a3e","Type":"ContainerStarted","Data":"16b68e634540905a1992daa58ef6a524b6a03d762010f8480151ec4150ebb525"}
Jul 21 16:25:51.291363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.291259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:25:51.292466 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.292444    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n7m7" event={"ID":"36259e17-91b0-4fd1-b01a-bc5e0b2efe99","Type":"ContainerStarted","Data":"fb23e0c8e76ba613ef08d1be9f2d83969c6c206adbcb7cd3d2ef78ce9d6de928"}
Jul 21 16:25:51.314121 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.314072    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" podStartSLOduration=24.314056655 podStartE2EDuration="24.314056655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:51.313763565 +0000 UTC m=+51.766318779" watchObservedRunningTime="2026-07-21 16:25:51.314056655 +0000 UTC m=+51.766611869"
Jul 21 16:25:51.318405 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.318377    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.418415 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.418384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.478571 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.478545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.609434 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.609406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.709879 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.709850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:51.985631 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:51.985504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.086650 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.086602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.187375 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.187334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.287348 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.287242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.387767 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.387737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:52.389910 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.389888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e689d56-e7a2-4563-9968-e8d65f018382-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jsxs2\" (UID: \"0e689d56-e7a2-4563-9968-e8d65f018382\") " pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:52.401867 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.401841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.426675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.426656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jsxs2"
Jul 21 16:25:52.503544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.503517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.567983 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.567919    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jsxs2"]
Jul 21 16:25:52.570585 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:25:52.570562    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e689d56_e7a2_4563_9968_e8d65f018382.slice/crio-721b3c0926b213ec027dc2db6848f8d6c7bdbbd635f797053d53651c92941cba WatchSource:0}: Error finding container 721b3c0926b213ec027dc2db6848f8d6c7bdbbd635f797053d53651c92941cba: Status 404 returned error can't find the container with id 721b3c0926b213ec027dc2db6848f8d6c7bdbbd635f797053d53651c92941cba
Jul 21 16:25:52.627186 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.627159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.692953 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.692926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:52.829464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:52.829402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:53.210812 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.210762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:53.306973 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.306932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jsxs2" event={"ID":"0e689d56-e7a2-4563-9968-e8d65f018382","Type":"ContainerStarted","Data":"721b3c0926b213ec027dc2db6848f8d6c7bdbbd635f797053d53651c92941cba"}
Jul 21 16:25:53.309625 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.309579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n7m7" event={"ID":"36259e17-91b0-4fd1-b01a-bc5e0b2efe99","Type":"ContainerStarted","Data":"f91e1c4894438b32210e8a5e17bacbd4e8dba2b1a8f07195fcae5b57aaf43a0f"}
Jul 21 16:25:53.309755 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.309634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n7m7" event={"ID":"36259e17-91b0-4fd1-b01a-bc5e0b2efe99","Type":"ContainerStarted","Data":"0384d1dc134670d284bfad8dda5f5c58531477e1184c9a3b4af4754e95177ccc"}
Jul 21 16:25:53.310368 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.310347    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:25:53.331921 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.331396    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6n7m7" podStartSLOduration=17.027006145 podStartE2EDuration="19.33137718s" totalImagesPullingTime="2.304371035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:53.331296321 +0000 UTC m=+53.783851535" watchObservedRunningTime="2026-07-21 16:25:53.33137718 +0000 UTC m=+53.783932392"
Jul 21 16:25:53.648235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.648186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:53.848830 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.848795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:53.949852 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:53.949769    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:54.050513 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:54.050484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:54.242734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:54.242651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:54.431294 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:54.431261    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:54.530785 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:54.530706    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:54.844072 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:54.843992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:55.641132 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:55.641102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:55.842922 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:55.842876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:56.241129 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:56.241085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:56.444265 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:56.444227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:56.653072 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:56.653041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:57.039934 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:57.039846    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:25:58.330330 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:25:58.330276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jsxs2" event={"ID":"0e689d56-e7a2-4563-9968-e8d65f018382","Type":"ContainerStarted","Data":"d2a04d4cd413030f58fda53e4c1b70ee1f9e520019e700ea6de12c2bf3d3e82f"}
Jul 21 16:26:00.234005 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.233973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sd5wp"
Jul 21 16:26:00.464602 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.464565    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"]
Jul 21 16:26:00.471769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.471745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.476062 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.476026    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 16:26:00.476172 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.476153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 16:26:00.477668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.477420    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 16:26:00.477668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.477545    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 16:26:00.478167 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.478053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 16:26:00.478635 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.478335    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 16:26:00.478635 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.478602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 16:26:00.483804 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.483780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:26:00.500741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.500677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"]
Jul 21 16:26:00.553468 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e3de9eb-4da0-45cf-9799-d61878375e3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.553632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.553632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8nn\" (UniqueName: \"kubernetes.io/projected/9e3de9eb-4da0-45cf-9799-d61878375e3b-kube-api-access-8d8nn\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.553632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.553632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.553632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.553572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.622955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.622864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:00.653969 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.653934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e3de9eb-4da0-45cf-9799-d61878375e3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.653981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.654014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8nn\" (UniqueName: \"kubernetes.io/projected/9e3de9eb-4da0-45cf-9799-d61878375e3b-kube-api-access-8d8nn\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.654039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.654064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.654096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.654820 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.654771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e3de9eb-4da0-45cf-9799-d61878375e3b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.657125 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.657096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.657222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.657138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-ca\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.657222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.657192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.657472 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.657454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9e3de9eb-4da0-45cf-9799-d61878375e3b-hub\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.677573 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.677539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8nn\" (UniqueName: \"kubernetes.io/projected/9e3de9eb-4da0-45cf-9799-d61878375e3b-kube-api-access-8d8nn\") pod \"cluster-proxy-proxy-agent-5b879c5654-m2k8v\" (UID: \"9e3de9eb-4da0-45cf-9799-d61878375e3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.740760 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.740721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:00.795354 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.795251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"
Jul 21 16:26:00.838185 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.838140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:00.934167 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.934138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v"]
Jul 21 16:26:00.937182 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:00.937157    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e3de9eb_4da0_45cf_9799_d61878375e3b.slice/crio-1a74361c7ec7d1bbcae0de6fcde1a873ad03648774980ac06a7cfae920b80784 WatchSource:0}: Error finding container 1a74361c7ec7d1bbcae0de6fcde1a873ad03648774980ac06a7cfae920b80784: Status 404 returned error can't find the container with id 1a74361c7ec7d1bbcae0de6fcde1a873ad03648774980ac06a7cfae920b80784
Jul 21 16:26:00.941069 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:00.941033    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:01.343129 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:01.343098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v" event={"ID":"9e3de9eb-4da0-45cf-9799-d61878375e3b","Type":"ContainerStarted","Data":"1a74361c7ec7d1bbcae0de6fcde1a873ad03648774980ac06a7cfae920b80784"}
Jul 21 16:26:01.345047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:01.345022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jsxs2" event={"ID":"0e689d56-e7a2-4563-9968-e8d65f018382","Type":"ContainerStarted","Data":"ef9b85e3d64bc15cd8a28f95c1b857a0d3d77507ad6723f7cdb5f50c7f7a58a5"}
Jul 21 16:26:04.319528 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:04.319498    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6n7m7"
Jul 21 16:26:04.541817 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:04.541768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:04.627413 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:04.627379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:05.803080 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.803047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:26:05.806577 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.806346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:26:05.815899 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.815877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5417bc96-b4c4-43ce-9e92-ee83800a0884-metrics-certs\") pod \"network-metrics-daemon-6dtfj\" (UID: \"5417bc96-b4c4-43ce-9e92-ee83800a0884\") " pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:26:05.904509 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.904470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:26:05.904681 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.904523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:26:05.907561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.907536    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:26:05.907679 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.907538    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:26:05.917637 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.917615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f49d953a-8e68-41d4-90bc-dcb7b1e2e778-original-pull-secret\") pod \"global-pull-secret-syncer-55rwx\" (UID: \"f49d953a-8e68-41d4-90bc-dcb7b1e2e778\") " pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:26:05.917750 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.917702    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:26:05.928461 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:05.928439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmj7b\" (UniqueName: \"kubernetes.io/projected/e440a4bb-887d-4f5b-9e5f-71f80b1fc597-kube-api-access-vmj7b\") pod \"network-check-target-svgc8\" (UID: \"e440a4bb-887d-4f5b-9e5f-71f80b1fc597\") " pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:26:06.016566 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.016537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crp4d\""
Jul 21 16:26:06.022065 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.022045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55rwx"
Jul 21 16:26:06.024162 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.024141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:26:06.029816 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.029792    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrbdq\""
Jul 21 16:26:06.037377 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.037344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dtfj"
Jul 21 16:26:06.561776 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.561747    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-svgc8"]
Jul 21 16:26:06.575730 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.575673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dtfj"]
Jul 21 16:26:06.578482 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:06.578459    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5417bc96_b4c4_43ce_9e92_ee83800a0884.slice/crio-ef2863ba8efb3769405122f0337f95be05032f4229597a53378e1e561a85842d WatchSource:0}: Error finding container ef2863ba8efb3769405122f0337f95be05032f4229597a53378e1e561a85842d: Status 404 returned error can't find the container with id ef2863ba8efb3769405122f0337f95be05032f4229597a53378e1e561a85842d
Jul 21 16:26:06.596483 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.596455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55rwx"]
Jul 21 16:26:06.598588 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:06.598565    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49d953a_8e68_41d4_90bc_dcb7b1e2e778.slice/crio-a3215be9f2e28455d0b8e9cf85a7d1c7cbc1738ca0d9c6833e36f70b4accbbef WatchSource:0}: Error finding container a3215be9f2e28455d0b8e9cf85a7d1c7cbc1738ca0d9c6833e36f70b4accbbef: Status 404 returned error can't find the container with id a3215be9f2e28455d0b8e9cf85a7d1c7cbc1738ca0d9c6833e36f70b4accbbef
Jul 21 16:26:06.724393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.724361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:06.823392 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.823357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:06.896362 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:06.896301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:07.085120 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.085001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:07.186619 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.186582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:07.373754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.373455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v" event={"ID":"9e3de9eb-4da0-45cf-9799-d61878375e3b","Type":"ContainerStarted","Data":"a9742ce4e77382b432b1bfe7ef21ba4e3e55f058adf754fc9e005726d07a94b0"}
Jul 21 16:26:07.373754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.373503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v" event={"ID":"9e3de9eb-4da0-45cf-9799-d61878375e3b","Type":"ContainerStarted","Data":"07fc237dd5f06d8b699c0d29711aad85c78440cd9ff2959ee6a7fb3c2e085d17"}
Jul 21 16:26:07.373754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.373522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v" event={"ID":"9e3de9eb-4da0-45cf-9799-d61878375e3b","Type":"ContainerStarted","Data":"2bdcf3d9d1c119ca7ad2f7fef04043fbed539ee7e1387dd433f223e2a4c27784"}
Jul 21 16:26:07.376428 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.376391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jsxs2" event={"ID":"0e689d56-e7a2-4563-9968-e8d65f018382","Type":"ContainerStarted","Data":"fbfdc574e18a1b2a113b7b7de355867a2f74c0598f2bc1d898bb031005650a6b"}
Jul 21 16:26:07.378326 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.378287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dtfj" event={"ID":"5417bc96-b4c4-43ce-9e92-ee83800a0884","Type":"ContainerStarted","Data":"ef2863ba8efb3769405122f0337f95be05032f4229597a53378e1e561a85842d"}
Jul 21 16:26:07.379994 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.379970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svgc8" event={"ID":"e440a4bb-887d-4f5b-9e5f-71f80b1fc597","Type":"ContainerStarted","Data":"2a5b11f71577e785af211c3f0f9e022174c09894497493b85082de74eb2d02a7"}
Jul 21 16:26:07.382166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.381975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55rwx" event={"ID":"f49d953a-8e68-41d4-90bc-dcb7b1e2e778","Type":"ContainerStarted","Data":"a3215be9f2e28455d0b8e9cf85a7d1c7cbc1738ca0d9c6833e36f70b4accbbef"}
Jul 21 16:26:07.396302 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.396245    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b879c5654-m2k8v" podStartSLOduration=1.835345864 podStartE2EDuration="7.396226401s" totalImagesPullingTime="5.560880537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:07.395632604 +0000 UTC m=+67.848187818" watchObservedRunningTime="2026-07-21 16:26:07.396226401 +0000 UTC m=+67.848781615"
Jul 21 16:26:07.421895 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.421845    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jsxs2" podStartSLOduration=17.69144593 podStartE2EDuration="31.421829483s" totalImagesPullingTime="13.730383553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:07.421583274 +0000 UTC m=+67.874138483" watchObservedRunningTime="2026-07-21 16:26:07.421829483 +0000 UTC m=+67.874384695"
Jul 21 16:26:07.593980 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.593945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:07.836391 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.836343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:07.941694 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:07.941666    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:08.389832 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.389794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dtfj" event={"ID":"5417bc96-b4c4-43ce-9e92-ee83800a0884","Type":"ContainerStarted","Data":"59713a9fc021f3198a473b1cce9a2a9a23b3144ee4d775d62147e0ba228372b6"}
Jul 21 16:26:08.390002 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.389928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dtfj" event={"ID":"5417bc96-b4c4-43ce-9e92-ee83800a0884","Type":"ContainerStarted","Data":"56896ab2835f16659ab0240c8334f93ef9c01e9f7ca3156cbe0c90d28a494920"}
Jul 21 16:26:08.409139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.409078    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6dtfj" podStartSLOduration=67.255447481 podStartE2EDuration="1m8.409060172s" totalImagesPullingTime="1.153612691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:08.40765029 +0000 UTC m=+68.860205503" watchObservedRunningTime="2026-07-21 16:26:08.409060172 +0000 UTC m=+68.861615383"
Jul 21 16:26:08.500713 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.500676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:08.562747 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.562710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:08.910837 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.910761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:08.969151 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:08.969121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:09.630900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:09.630857    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:09.735088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:09.735048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:09.833344 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:09.833291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:09.897047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:09.896962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:10.489792 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:10.489738    2577 patch_prober.go:28] interesting pod/image-registry-6796d45784-bjp2c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 16:26:10.490160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:10.489797    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:26:11.400931 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:11.400891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-svgc8" event={"ID":"e440a4bb-887d-4f5b-9e5f-71f80b1fc597","Type":"ContainerStarted","Data":"5c2dffdaee6e5c1344659f0f45479ae29ad9fe5e9d5dce243232daf7b643d775"}
Jul 21 16:26:11.401115 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:11.401013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:26:11.402289 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:11.402262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55rwx" event={"ID":"f49d953a-8e68-41d4-90bc-dcb7b1e2e778","Type":"ContainerStarted","Data":"61cc3adc6e9b124e88a1d55d058cbd691f7fb5414f213831d1c90be988553a9f"}
Jul 21 16:26:11.420131 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:11.420088    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-svgc8" podStartSLOduration=66.953451384 podStartE2EDuration="1m11.420073452s" totalImagesPullingTime="4.466622068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:11.418290968 +0000 UTC m=+71.870846178" watchObservedRunningTime="2026-07-21 16:26:11.420073452 +0000 UTC m=+71.872628664"
Jul 21 16:26:11.434631 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:11.434577    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-55rwx" podStartSLOduration=65.993735322 podStartE2EDuration="1m10.434554616s" totalImagesPullingTime="4.440819294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:11.433848088 +0000 UTC m=+71.886403301" watchObservedRunningTime="2026-07-21 16:26:11.434554616 +0000 UTC m=+71.887109829"
Jul 21 16:26:12.216707 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:12.216660    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:12.316441 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:12.316412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:12.913047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:12.913011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.032659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.032620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.200177 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.200087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.488010 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.487929    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.588385 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.588353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.697952 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.697915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:13.803832 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:13.803760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:14.432247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:14.432221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:14.533261 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:14.533229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:16.008425 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:16.008395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:16.109108 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:16.109070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:16.828212 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:16.828178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:16.928779 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:16.928749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.059656 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.059619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.329246 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.329152    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.355237 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.355211    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"]
Jul 21 16:26:18.358374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.358358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.365382 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.365363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 16:26:18.365484 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.365395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:26:18.365484 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.365440    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 16:26:18.365484 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.365366    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:26:18.365641 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.365487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bx69j\""
Jul 21 16:26:18.366894 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.366877    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:26:18.371533 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.371515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"]
Jul 21 16:26:18.393917 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.393894    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cfdk2"]
Jul 21 16:26:18.395832 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.395817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.400168 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.400145    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:26:18.400256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.400146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-42mkg\""
Jul 21 16:26:18.400256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.400153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:26:18.400496 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.400478    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:26:18.432893 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.432873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.498280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-textfile\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f68bf870-7c6c-4a1d-88f4-4191ea774272-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.498464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-sys\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-wtmp\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-metrics-client-ca\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rqtk\" (UniqueName: \"kubernetes.io/projected/f68bf870-7c6c-4a1d-88f4-4191ea774272-kube-api-access-7rqtk\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.498464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-root\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.498616 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.498614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jl9\" (UniqueName: \"kubernetes.io/projected/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-kube-api-access-d6jl9\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.527151 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.527122    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.599421 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599421 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.599421 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-root\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jl9\" (UniqueName: \"kubernetes.io/projected/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-kube-api-access-d6jl9\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:26:18.599506    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-textfile\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-root\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f68bf870-7c6c-4a1d-88f4-4191ea774272-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:26:18.599511    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:26:18.599606    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls podName:f68bf870-7c6c-4a1d-88f4-4191ea774272 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:19.099583433 +0000 UTC m=+79.552138628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-4q2dn" (UID: "f68bf870-7c6c-4a1d-88f4-4191ea774272") : secret "openshift-state-metrics-tls" not found
Jul 21 16:26:18.599675 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:26:18.599650    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls podName:20403ff5-1e11-4c9e-bbdf-f41fb6e8343d nodeName:}" failed. No retries permitted until 2026-07-21 16:26:19.099638784 +0000 UTC m=+79.552193979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls") pod "node-exporter-cfdk2" (UID: "20403ff5-1e11-4c9e-bbdf-f41fb6e8343d") : secret "node-exporter-tls" not found
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-sys\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-wtmp\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-metrics-client-ca\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-textfile\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rqtk\" (UniqueName: \"kubernetes.io/projected/f68bf870-7c6c-4a1d-88f4-4191ea774272-kube-api-access-7rqtk\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-sys\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.599935    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-wtmp\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.600115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.600600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.600289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f68bf870-7c6c-4a1d-88f4-4191ea774272-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.600600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.600469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-metrics-client-ca\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.601825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.601808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.601988 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.601963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.608973 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.608947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rqtk\" (UniqueName: \"kubernetes.io/projected/f68bf870-7c6c-4a1d-88f4-4191ea774272-kube-api-access-7rqtk\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:18.609068 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.609003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jl9\" (UniqueName: \"kubernetes.io/projected/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-kube-api-access-d6jl9\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:18.627100 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.627071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.729476 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.729451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.829262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.829232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:18.929820 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:18.929792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:19.028998 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.028968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:19.104090 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.104052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:19.104548 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.104092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:19.106324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.106293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20403ff5-1e11-4c9e-bbdf-f41fb6e8343d-node-exporter-tls\") pod \"node-exporter-cfdk2\" (UID: \"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d\") " pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:19.106422 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.106406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f68bf870-7c6c-4a1d-88f4-4191ea774272-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4q2dn\" (UID: \"f68bf870-7c6c-4a1d-88f4-4191ea774272\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:19.266825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.266744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"
Jul 21 16:26:19.304231 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.304203    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfdk2"
Jul 21 16:26:19.317246 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:19.314939    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20403ff5_1e11_4c9e_bbdf_f41fb6e8343d.slice/crio-7e2240d98c40548e9a54b319724667cb4a73376898817f7de43776c432b2cdd9 WatchSource:0}: Error finding container 7e2240d98c40548e9a54b319724667cb4a73376898817f7de43776c432b2cdd9: Status 404 returned error can't find the container with id 7e2240d98c40548e9a54b319724667cb4a73376898817f7de43776c432b2cdd9
Jul 21 16:26:19.317246 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.316586    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:19.392226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.392119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn"]
Jul 21 16:26:19.394176 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:19.394151    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68bf870_7c6c_4a1d_88f4_4191ea774272.slice/crio-b30779819e87b52074ce87805d73fc24ad25b3b45e50421ef50ae269b810074f WatchSource:0}: Error finding container b30779819e87b52074ce87805d73fc24ad25b3b45e50421ef50ae269b810074f: Status 404 returned error can't find the container with id b30779819e87b52074ce87805d73fc24ad25b3b45e50421ef50ae269b810074f
Jul 21 16:26:19.402619 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.402591    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:19.428611 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.428586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn" event={"ID":"f68bf870-7c6c-4a1d-88f4-4191ea774272","Type":"ContainerStarted","Data":"b30779819e87b52074ce87805d73fc24ad25b3b45e50421ef50ae269b810074f"}
Jul 21 16:26:19.429831 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.429799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfdk2" event={"ID":"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d","Type":"ContainerStarted","Data":"7e2240d98c40548e9a54b319724667cb4a73376898817f7de43776c432b2cdd9"}
Jul 21 16:26:19.518192 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.518106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:19.618342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:19.618293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:20.437545 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:20.437505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn" event={"ID":"f68bf870-7c6c-4a1d-88f4-4191ea774272","Type":"ContainerStarted","Data":"8c0104b249e5ba947db35d5560e5b0c883f45fad1f53f523054d6709b1670419"}
Jul 21 16:26:20.438004 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:20.437574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn" event={"ID":"f68bf870-7c6c-4a1d-88f4-4191ea774272","Type":"ContainerStarted","Data":"77bc6dff5117457ac012c21ebab9e9adf464011866ed6361a13be09fe13d2e56"}
Jul 21 16:26:20.488494 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:20.488465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:26:21.188545 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.188507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:21.290209 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.290176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:21.388837 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.388800    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:21.442567 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.442490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn" event={"ID":"f68bf870-7c6c-4a1d-88f4-4191ea774272","Type":"ContainerStarted","Data":"01c811b9a77c6b560ca5de72f8ce37568fb7cd80752ab7b0dca88568b2e7e947"}
Jul 21 16:26:21.444039 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.444014    2577 generic.go:356] "Generic (PLEG): container finished" podID="20403ff5-1e11-4c9e-bbdf-f41fb6e8343d" containerID="c152c2dd5f22757afe82f0580bf6a104e38c21d88848532d67d6c5f45571863b" exitCode=0
Jul 21 16:26:21.444163 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.444048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfdk2" event={"ID":"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d","Type":"ContainerDied","Data":"c152c2dd5f22757afe82f0580bf6a104e38c21d88848532d67d6c5f45571863b"}
Jul 21 16:26:21.467409 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.467368    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4q2dn" podStartSLOduration=2.427470689 podStartE2EDuration="3.467352482s" totalImagesPullingTime="1.039881793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:21.465225745 +0000 UTC m=+81.917780958" watchObservedRunningTime="2026-07-21 16:26:21.467352482 +0000 UTC m=+81.919907694"
Jul 21 16:26:21.496146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.496111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:21.636964 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:21.636925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.450450 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.450411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfdk2" event={"ID":"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d","Type":"ContainerStarted","Data":"790fc0dea547effeafefe359fc8ca23633a460564b34bc733131676fb01b50d7"}
Jul 21 16:26:22.450864 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.450480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfdk2" event={"ID":"20403ff5-1e11-4c9e-bbdf-f41fb6e8343d","Type":"ContainerStarted","Data":"5df181903f0ec72e8056642eb6605a64ff90b1e5e045ef88997b0892bece5655"}
Jul 21 16:26:22.473334 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.473281    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cfdk2" podStartSLOduration=3.191003437 podStartE2EDuration="4.473266317s" totalImagesPullingTime="1.216624126s" totalInitContainerRuntime="65.638754ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:22.471067575 +0000 UTC m=+82.923622789" watchObservedRunningTime="2026-07-21 16:26:22.473266317 +0000 UTC m=+82.925821529"
Jul 21 16:26:22.505668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.505646    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.602184 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.602143    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.691280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.691239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.782017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.781947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.842349 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.842295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:22.899086 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:22.899060    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:23.116486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.116453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:23.125105 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.125079    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"]
Jul 21 16:26:23.129369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.129355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.132230 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.132207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 16:26:23.132365 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.132258    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2fv22\""
Jul 21 16:26:23.138104 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.138075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"]
Jul 21 16:26:23.212527 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.212483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:23.233536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.233511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8681fcc4-650f-48ab-8317-22f27f7694b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.233618 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.233560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7j7\" (UniqueName: \"kubernetes.io/projected/8681fcc4-650f-48ab-8317-22f27f7694b4-kube-api-access-pf7j7\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.332954 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.332927    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:23.333879 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.333861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8681fcc4-650f-48ab-8317-22f27f7694b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.333944 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.333903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7j7\" (UniqueName: \"kubernetes.io/projected/8681fcc4-650f-48ab-8317-22f27f7694b4-kube-api-access-pf7j7\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.336262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.336244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8681fcc4-650f-48ab-8317-22f27f7694b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.342141 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.342118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7j7\" (UniqueName: \"kubernetes.io/projected/8681fcc4-650f-48ab-8317-22f27f7694b4-kube-api-access-pf7j7\") pod \"monitoring-plugin-7b7b7bc8bf-hm4cz\" (UID: \"8681fcc4-650f-48ab-8317-22f27f7694b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.437937 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.437863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:23.572844 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.572812    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b9747f688-hkvz8"]
Jul 21 16:26:23.576975 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.576957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.579379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.579359    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"]
Jul 21 16:26:23.580090 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hv59q\""
Jul 21 16:26:23.580183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580098    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 16:26:23.580183 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 16:26:23.580289 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580192    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 16:26:23.580490 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580468    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 16:26:23.580603 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.580535    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 16:26:23.582076 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:23.582055    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8681fcc4_650f_48ab_8317_22f27f7694b4.slice/crio-c6b6b29facd82e88feaaf1d7acf8b00e1f104f8fcba29ecd92901207f250d9c3 WatchSource:0}: Error finding container c6b6b29facd82e88feaaf1d7acf8b00e1f104f8fcba29ecd92901207f250d9c3: Status 404 returned error can't find the container with id c6b6b29facd82e88feaaf1d7acf8b00e1f104f8fcba29ecd92901207f250d9c3
Jul 21 16:26:23.586226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.586209    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 16:26:23.592698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.592673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9747f688-hkvz8"]
Jul 21 16:26:23.737818 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.737818 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.737818 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.738054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.738054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-serving-certs-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.738054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59qv\" (UniqueName: \"kubernetes.io/projected/21dd030d-c0dd-4acc-b660-c38c31cbee87-kube-api-access-f59qv\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.738054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.737989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-metrics-client-ca\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.738054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.738044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-federate-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-serving-certs-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f59qv\" (UniqueName: \"kubernetes.io/projected/21dd030d-c0dd-4acc-b660-c38c31cbee87-kube-api-access-f59qv\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-metrics-client-ca\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-federate-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839274 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839943 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-serving-certs-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.839943 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.839916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-metrics-client-ca\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.840280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.840175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.841675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.841649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-telemeter-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.841766 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.841713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.841887 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.841867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-federate-client-tls\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.841922 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.841867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21dd030d-c0dd-4acc-b660-c38c31cbee87-secret-telemeter-client\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.848683 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.848664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59qv\" (UniqueName: \"kubernetes.io/projected/21dd030d-c0dd-4acc-b660-c38c31cbee87-kube-api-access-f59qv\") pod \"telemeter-client-5b9747f688-hkvz8\" (UID: \"21dd030d-c0dd-4acc-b660-c38c31cbee87\") " pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:23.893606 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:23.893588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8"
Jul 21 16:26:24.019693 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.019668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9747f688-hkvz8"]
Jul 21 16:26:24.021346 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:24.021305    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21dd030d_c0dd_4acc_b660_c38c31cbee87.slice/crio-b0400a37307a3053ca04c0989c8a6f6144f3294c2a1de8cd4e37ef3a68895c4b WatchSource:0}: Error finding container b0400a37307a3053ca04c0989c8a6f6144f3294c2a1de8cd4e37ef3a68895c4b: Status 404 returned error can't find the container with id b0400a37307a3053ca04c0989c8a6f6144f3294c2a1de8cd4e37ef3a68895c4b
Jul 21 16:26:24.458939 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.458898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8" event={"ID":"21dd030d-c0dd-4acc-b660-c38c31cbee87","Type":"ContainerStarted","Data":"b0400a37307a3053ca04c0989c8a6f6144f3294c2a1de8cd4e37ef3a68895c4b"}
Jul 21 16:26:24.460140 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.460112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz" event={"ID":"8681fcc4-650f-48ab-8317-22f27f7694b4","Type":"ContainerStarted","Data":"c6b6b29facd82e88feaaf1d7acf8b00e1f104f8fcba29ecd92901207f250d9c3"}
Jul 21 16:26:24.544291 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.544249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:24.651428 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.651385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:24.810188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:24.810096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:25.470844 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.470800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz" event={"ID":"8681fcc4-650f-48ab-8317-22f27f7694b4","Type":"ContainerStarted","Data":"adac0abfe0a6f4f209923bd542144b2568e0394fc8ebff9f9e7b9d22e15d5b8c"}
Jul 21 16:26:25.471053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.471027    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:25.476659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.476634    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz"
Jul 21 16:26:25.488372 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.488325    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hm4cz" podStartSLOduration=0.96687162 podStartE2EDuration="2.488298041s" totalImagesPullingTime="1.521426421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:25.487857774 +0000 UTC m=+85.940412991" watchObservedRunningTime="2026-07-21 16:26:25.488298041 +0000 UTC m=+85.940853252"
Jul 21 16:26:25.505501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.505469    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerName="registry" containerID="cri-o://2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c" gracePeriod=30
Jul 21 16:26:25.740356 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.740328    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:26:25.856697 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856706    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856772    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-884vl\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856826    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.856861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.857188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.856904    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates\") pod \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\" (UID: \"4880c6fc-1273-44fb-a9fb-d2d30e230a3e\") "
Jul 21 16:26:25.857569 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.857540    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:25.857780 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.857742    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:25.859698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.859670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:25.859815 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.859699    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl" (OuterVolumeSpecName: "kube-api-access-884vl") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "kube-api-access-884vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:26:25.859815 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.859744    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:26:25.859936 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.859899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:26:25.859984 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.859944    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:25.868665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.868634    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4880c6fc-1273-44fb-a9fb-d2d30e230a3e" (UID: "4880c6fc-1273-44fb-a9fb-d2d30e230a3e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:26:25.958293 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958261    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958293 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958290    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-image-registry-private-configuration\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958293 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958301    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-trusted-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958333    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-884vl\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-kube-api-access-884vl\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958348    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-bound-sa-token\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958361    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-ca-trust-extracted\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958377    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-installation-pull-secrets\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:25.958551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:25.958390    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4880c6fc-1273-44fb-a9fb-d2d30e230a3e-registry-certificates\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:26:26.475600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.475518    2577 generic.go:356] "Generic (PLEG): container finished" podID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerID="2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c" exitCode=0
Jul 21 16:26:26.475600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.475564    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6796d45784-bjp2c"
Jul 21 16:26:26.475777 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.475601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" event={"ID":"4880c6fc-1273-44fb-a9fb-d2d30e230a3e","Type":"ContainerDied","Data":"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"}
Jul 21 16:26:26.475777 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.475658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6796d45784-bjp2c" event={"ID":"4880c6fc-1273-44fb-a9fb-d2d30e230a3e","Type":"ContainerDied","Data":"16b68e634540905a1992daa58ef6a524b6a03d762010f8480151ec4150ebb525"}
Jul 21 16:26:26.475777 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.475689    2577 scope.go:117] "RemoveContainer" containerID="2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"
Jul 21 16:26:26.477346 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.477327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8" event={"ID":"21dd030d-c0dd-4acc-b660-c38c31cbee87","Type":"ContainerStarted","Data":"a29ba0b49b02b6df60b8379cb9b95d5c8eb93b513b13f14b26ac9883bddb22ac"}
Jul 21 16:26:26.484622 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.484602    2577 scope.go:117] "RemoveContainer" containerID="2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"
Jul 21 16:26:26.484885 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:26:26.484850    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c\": container with ID starting with 2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c not found: ID does not exist" containerID="2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"
Jul 21 16:26:26.484989 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.484880    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c"} err="failed to get container status \"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c\": rpc error: code = NotFound desc = could not find container \"2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c\": container with ID starting with 2b271bae58aad4ae5633eb8b152da30829352d4f3ed010bc49ab283cbed40e1c not found: ID does not exist"
Jul 21 16:26:26.493861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.493840    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:26:26.497931 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:26.497913    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6796d45784-bjp2c"]
Jul 21 16:26:27.484049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:27.484009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8" event={"ID":"21dd030d-c0dd-4acc-b660-c38c31cbee87","Type":"ContainerStarted","Data":"313ae1138fab27bf846abfcc7357a12ad80e2d9eceb401671773a39fa8f5d6e3"}
Jul 21 16:26:27.484455 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:27.484072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8" event={"ID":"21dd030d-c0dd-4acc-b660-c38c31cbee87","Type":"ContainerStarted","Data":"81facb8a3aa5572efd5280513ba61911588d3eb04779b651c4b001372e35df80"}
Jul 21 16:26:27.509010 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:27.508957    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b9747f688-hkvz8" podStartSLOduration=1.30354861 podStartE2EDuration="4.508941334s" totalImagesPullingTime="3.205392724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:27.507866696 +0000 UTC m=+87.960421907" watchObservedRunningTime="2026-07-21 16:26:27.508941334 +0000 UTC m=+87.961496545"
Jul 21 16:26:28.105909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.105866    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" path="/var/lib/kubelet/pods/4880c6fc-1273-44fb-a9fb-d2d30e230a3e/volumes"
Jul 21 16:26:28.464363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.464273    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:26:28.464537 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.464524    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerName="registry"
Jul 21 16:26:28.464586 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.464539    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerName="registry"
Jul 21 16:26:28.464586 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.464583    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4880c6fc-1273-44fb-a9fb-d2d30e230a3e" containerName="registry"
Jul 21 16:26:28.467532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.467517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.470540 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.470517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 16:26:28.470657 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.470525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 16:26:28.471947 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.471933    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 16:26:28.472169 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.472144    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 16:26:28.472169 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.472154    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:26:28.472304 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.472155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mztl5\""
Jul 21 16:26:28.472304 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.472232    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:26:28.472304 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.472156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 16:26:28.477790 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.477769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 16:26:28.478292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.478275    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:26:28.577257 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577257 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.577765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.577595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7x7w\" (UniqueName: \"kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678560 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7x7w\" (UniqueName: \"kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.678715 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.678708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.679306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.679283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.679418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.679330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.679464 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.679444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.679653 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.679632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.681146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.681120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.681245 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.681233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.687085 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.687056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7x7w\" (UniqueName: \"kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w\") pod \"console-8454d9ffbc-cqmdz\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") " pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.777541 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.777484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:28.811460 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.811421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:28.902026 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.901997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:26:28.905595 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:28.905569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:28.907611 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:26:28.907585    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf916b642_c32c_435f_8908_0dee9f223445.slice/crio-c50ca70b81ecc173eb0a1bd663b1a69c0511397f9f03aa6e235824c4b72eb36a WatchSource:0}: Error finding container c50ca70b81ecc173eb0a1bd663b1a69c0511397f9f03aa6e235824c4b72eb36a: Status 404 returned error can't find the container with id c50ca70b81ecc173eb0a1bd663b1a69c0511397f9f03aa6e235824c4b72eb36a
Jul 21 16:26:29.414529 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:29.414493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:29.476292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:29.476247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:29.492650 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:29.492607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8454d9ffbc-cqmdz" event={"ID":"f916b642-c32c-435f-8908-0dee9f223445","Type":"ContainerStarted","Data":"c50ca70b81ecc173eb0a1bd663b1a69c0511397f9f03aa6e235824c4b72eb36a"}
Jul 21 16:26:31.120153 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:31.120113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:31.174072 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:31.174021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:31.464774 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:31.464680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:31.522864 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:31.522824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:32.504575 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:32.504499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8454d9ffbc-cqmdz" event={"ID":"f916b642-c32c-435f-8908-0dee9f223445","Type":"ContainerStarted","Data":"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"}
Jul 21 16:26:32.523446 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:32.523401    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8454d9ffbc-cqmdz" podStartSLOduration=1.304147011 podStartE2EDuration="4.523387094s" totalImagesPullingTime="3.219240083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:32.521733172 +0000 UTC m=+92.974288384" watchObservedRunningTime="2026-07-21 16:26:32.523387094 +0000 UTC m=+92.975942305"
Jul 21 16:26:38.778191 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:38.778158    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:38.778570 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:38.778236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:38.782936 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:38.782917    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:38.915734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:38.915656    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:38.972976 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:38.972946    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:39.531629 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:39.531601    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:26:39.682268 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:39.682232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:39.788535 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:39.788455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:39.886845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:39.886819    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:42.408535 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:42.408507    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-svgc8"
Jul 21 16:26:51.208222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:51.208188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:51.309939 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:51.309899    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:54.143057 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:54.143015    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:26:54.203995 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:26:54.203962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:01.056635 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:01.056593    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:01.154769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:01.154738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:01.208675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:01.208637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:32.505981 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:32.505941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:34.478568 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:34.478520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:35.192733 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:35.192689    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:46.428173 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:46.428132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:46.528970 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:46.528931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:47.095101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.095066    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:27:47.097281 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.097255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.112217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.112196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:27:47.178734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.178704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:47.229749 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.229888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.229888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.229888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvj9\" (UniqueName: \"kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.229888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.230035 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.230035 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.229944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.330776 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.330881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvj9\" (UniqueName: \"kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.330881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.330881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.330881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331032 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331032 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.330922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.331507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331643 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.331606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331705 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.331693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.331762 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.331695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.333229 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.333196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.333354 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.333287    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.340277 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.340256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvj9\" (UniqueName: \"kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9\") pod \"console-8579475db5-qmk6j\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") " pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.407836 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.407803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:47.528986 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.528952    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:27:47.531321 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:27:47.531281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cb7e83_3f26_43a1_b340_b906a9bd8510.slice/crio-527c2a5955f57c9b0baf4ce9b065539f2854e474209477d387bee22a5302578b WatchSource:0}: Error finding container 527c2a5955f57c9b0baf4ce9b065539f2854e474209477d387bee22a5302578b: Status 404 returned error can't find the container with id 527c2a5955f57c9b0baf4ce9b065539f2854e474209477d387bee22a5302578b
Jul 21 16:27:47.754951 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.754869    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8579475db5-qmk6j" event={"ID":"e9cb7e83-3f26-43a1-b340-b906a9bd8510","Type":"ContainerStarted","Data":"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"}
Jul 21 16:27:47.754951 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.754915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8579475db5-qmk6j" event={"ID":"e9cb7e83-3f26-43a1-b340-b906a9bd8510","Type":"ContainerStarted","Data":"527c2a5955f57c9b0baf4ce9b065539f2854e474209477d387bee22a5302578b"}
Jul 21 16:27:47.773384 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:47.773336    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8579475db5-qmk6j" podStartSLOduration=0.773304962 podStartE2EDuration="773.304962ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:47.771780544 +0000 UTC m=+168.224335752" watchObservedRunningTime="2026-07-21 16:27:47.773304962 +0000 UTC m=+168.225860174"
Jul 21 16:27:53.923948 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:53.923862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:54.020675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:54.020638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:57.408587 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.408548    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:57.408973 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.408615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:57.413200 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.413173    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:57.794000 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.793918    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:27:57.844235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.844205    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:27:57.954093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:57.954048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:58.014066 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:58.014038    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:27:58.074223 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:27:58.074146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:22.870807 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:22.870747    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8454d9ffbc-cqmdz" podUID="f916b642-c32c-435f-8908-0dee9f223445" containerName="console" containerID="cri-o://c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da" gracePeriod=15
Jul 21 16:28:23.103523 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.103497    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:28:23.195785 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195707    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.195785 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.195785 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.196049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.196049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7x7w\" (UniqueName: \"kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.196049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195878    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.196049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.195920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config\") pod \"f916b642-c32c-435f-8908-0dee9f223445\" (UID: \"f916b642-c32c-435f-8908-0dee9f223445\") "
Jul 21 16:28:23.196255 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.196204    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:23.196374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.196232    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:23.196430 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.196384    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca" (OuterVolumeSpecName: "service-ca") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:23.196430 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.196402    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config" (OuterVolumeSpecName: "console-config") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:28:23.198026 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.197992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w" (OuterVolumeSpecName: "kube-api-access-n7x7w") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "kube-api-access-n7x7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:28:23.198026 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.197998    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:28:23.198155 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.198035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f916b642-c32c-435f-8908-0dee9f223445" (UID: "f916b642-c32c-435f-8908-0dee9f223445"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:28:23.296466 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296435    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-oauth-config\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296466 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296460    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-trusted-ca-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296466 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296471    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-oauth-serving-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296480    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296490    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7x7w\" (UniqueName: \"kubernetes.io/projected/f916b642-c32c-435f-8908-0dee9f223445-kube-api-access-n7x7w\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296498    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f916b642-c32c-435f-8908-0dee9f223445-console-serving-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.296647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.296506    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f916b642-c32c-435f-8908-0dee9f223445-console-config\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:28:23.876996 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.876958    2577 generic.go:356] "Generic (PLEG): container finished" podID="f916b642-c32c-435f-8908-0dee9f223445" containerID="c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da" exitCode=0
Jul 21 16:28:23.877433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.877005    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8454d9ffbc-cqmdz"
Jul 21 16:28:23.877433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.877045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8454d9ffbc-cqmdz" event={"ID":"f916b642-c32c-435f-8908-0dee9f223445","Type":"ContainerDied","Data":"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"}
Jul 21 16:28:23.877433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.877098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8454d9ffbc-cqmdz" event={"ID":"f916b642-c32c-435f-8908-0dee9f223445","Type":"ContainerDied","Data":"c50ca70b81ecc173eb0a1bd663b1a69c0511397f9f03aa6e235824c4b72eb36a"}
Jul 21 16:28:23.877433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.877120    2577 scope.go:117] "RemoveContainer" containerID="c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"
Jul 21 16:28:23.885596 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.885580    2577 scope.go:117] "RemoveContainer" containerID="c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"
Jul 21 16:28:23.885865 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:28:23.885844    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da\": container with ID starting with c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da not found: ID does not exist" containerID="c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"
Jul 21 16:28:23.885922 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.885878    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da"} err="failed to get container status \"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da\": rpc error: code = NotFound desc = could not find container \"c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da\": container with ID starting with c986c4c1dc65158ec271ab2a800cc3ba578d661ca721c085d51362ec768f28da not found: ID does not exist"
Jul 21 16:28:23.897894 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.897871    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:28:23.902563 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:23.902543    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8454d9ffbc-cqmdz"]
Jul 21 16:28:24.106255 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:24.106221    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f916b642-c32c-435f-8908-0dee9f223445" path="/var/lib/kubelet/pods/f916b642-c32c-435f-8908-0dee9f223445/volumes"
Jul 21 16:28:30.858408 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:30.858369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:30.955082 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:30.955048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:31.550716 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.550683    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"]
Jul 21 16:28:31.550941 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.550930    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f916b642-c32c-435f-8908-0dee9f223445" containerName="console"
Jul 21 16:28:31.550987 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.550943    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f916b642-c32c-435f-8908-0dee9f223445" containerName="console"
Jul 21 16:28:31.551020 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.550997    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f916b642-c32c-435f-8908-0dee9f223445" containerName="console"
Jul 21 16:28:31.554124 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.554105    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.557045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.557026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:28:31.558220 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.558200    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:28:31.558220 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.558213    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bwrp2\""
Jul 21 16:28:31.562277 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.562258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"]
Jul 21 16:28:31.652914 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.652880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44zg\" (UniqueName: \"kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.653057 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.652933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.653057 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.653006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.753640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.753607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44zg\" (UniqueName: \"kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.753775 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.753652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.753775 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.753674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.754063 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.754042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.754101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.754055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.762546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.762519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44zg\" (UniqueName: \"kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.862978 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.862958    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:28:31.982935 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:31.982883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"]
Jul 21 16:28:31.985465 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:28:31.985443    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8818589d_42d8_483d_a53a_938a25a4ac79.slice/crio-7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47 WatchSource:0}: Error finding container 7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47: Status 404 returned error can't find the container with id 7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47
Jul 21 16:28:32.165764 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:32.165687    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:32.224953 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:32.224926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:32.909132 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:32.909095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerStarted","Data":"7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47"}
Jul 21 16:28:39.935698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:39.935665    2577 generic.go:356] "Generic (PLEG): container finished" podID="8818589d-42d8-483d-a53a-938a25a4ac79" containerID="c4b7798b7201000edb9baf024515ea2e47ad60fcadaf017476fa6557de6b8231" exitCode=0
Jul 21 16:28:39.936062 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:39.935700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerDied","Data":"c4b7798b7201000edb9baf024515ea2e47ad60fcadaf017476fa6557de6b8231"}
Jul 21 16:28:42.703428 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:42.703391    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:42.770927 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:42.770892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:28:52.981981 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:52.981947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerStarted","Data":"f79f147aa81e18b2aea91782089c00bbcbc945a81fe8655bfa6a2f53796f47b4"}
Jul 21 16:28:53.987412 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:53.987381    2577 generic.go:356] "Generic (PLEG): container finished" podID="8818589d-42d8-483d-a53a-938a25a4ac79" containerID="f79f147aa81e18b2aea91782089c00bbcbc945a81fe8655bfa6a2f53796f47b4" exitCode=0
Jul 21 16:28:53.987800 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:28:53.987471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerDied","Data":"f79f147aa81e18b2aea91782089c00bbcbc945a81fe8655bfa6a2f53796f47b4"}
Jul 21 16:29:01.018597 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:01.018563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerStarted","Data":"26106ddf2eac13b68d4f66b8ca825473d225334957e5ff7c6e90d726116e42ae"}
Jul 21 16:29:01.038157 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:01.038105    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" podStartSLOduration=2.90439939 podStartE2EDuration="30.038090381s" totalImagesPullingTime="27.133690991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:01.03681761 +0000 UTC m=+241.489372861" watchObservedRunningTime="2026-07-21 16:29:01.038090381 +0000 UTC m=+241.490645593"
Jul 21 16:29:02.024194 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:02.024156    2577 generic.go:356] "Generic (PLEG): container finished" podID="8818589d-42d8-483d-a53a-938a25a4ac79" containerID="26106ddf2eac13b68d4f66b8ca825473d225334957e5ff7c6e90d726116e42ae" exitCode=0
Jul 21 16:29:02.024655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:02.024222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerDied","Data":"26106ddf2eac13b68d4f66b8ca825473d225334957e5ff7c6e90d726116e42ae"}
Jul 21 16:29:03.152202 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.152178    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:29:03.308673 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.308566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r44zg\" (UniqueName: \"kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg\") pod \"8818589d-42d8-483d-a53a-938a25a4ac79\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") "
Jul 21 16:29:03.308828 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.308694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle\") pod \"8818589d-42d8-483d-a53a-938a25a4ac79\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") "
Jul 21 16:29:03.308828 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.308718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util\") pod \"8818589d-42d8-483d-a53a-938a25a4ac79\" (UID: \"8818589d-42d8-483d-a53a-938a25a4ac79\") "
Jul 21 16:29:03.309532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.309509    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle" (OuterVolumeSpecName: "bundle") pod "8818589d-42d8-483d-a53a-938a25a4ac79" (UID: "8818589d-42d8-483d-a53a-938a25a4ac79"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:03.310697 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.310675    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg" (OuterVolumeSpecName: "kube-api-access-r44zg") pod "8818589d-42d8-483d-a53a-938a25a4ac79" (UID: "8818589d-42d8-483d-a53a-938a25a4ac79"). InnerVolumeSpecName "kube-api-access-r44zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:03.313998 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.313974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util" (OuterVolumeSpecName: "util") pod "8818589d-42d8-483d-a53a-938a25a4ac79" (UID: "8818589d-42d8-483d-a53a-938a25a4ac79"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:03.409439 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.409393    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r44zg\" (UniqueName: \"kubernetes.io/projected/8818589d-42d8-483d-a53a-938a25a4ac79-kube-api-access-r44zg\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:03.409439 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.409435    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:03.409439 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:03.409445    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8818589d-42d8-483d-a53a-938a25a4ac79-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:04.032489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:04.032456    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk"
Jul 21 16:29:04.032489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:04.032469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4zk" event={"ID":"8818589d-42d8-483d-a53a-938a25a4ac79","Type":"ContainerDied","Data":"7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47"}
Jul 21 16:29:04.032683 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:04.032515    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bb9d27e2560979361f62b43ed927980ea542b88a1559a7b12d1c85aca0bde47"
Jul 21 16:29:08.040305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:08.040277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:08.513927 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:08.513890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:11.503685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:11.503643    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:11.560226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:11.560198    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.134115 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.134085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.235953 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.235923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.354127 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.354090    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.452812 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.452729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:13.978199 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978170    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"]
Jul 21 16:29:13.978455 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978441    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="pull"
Jul 21 16:29:13.978501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978457    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="pull"
Jul 21 16:29:13.978501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978474    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="extract"
Jul 21 16:29:13.978501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978482    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="extract"
Jul 21 16:29:13.978501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978501    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="util"
Jul 21 16:29:13.978624 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978507    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="util"
Jul 21 16:29:13.978624 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.978544    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8818589d-42d8-483d-a53a-938a25a4ac79" containerName="extract"
Jul 21 16:29:13.980566 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.980551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:13.983486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.983464    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:29:13.983667 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.983651    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bwrp2\""
Jul 21 16:29:13.985111 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.985093    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:29:13.992324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:13.992296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"]
Jul 21 16:29:14.087476 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.087442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxnq\" (UniqueName: \"kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.087665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.087490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.087665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.087583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.188334 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.188273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxnq\" (UniqueName: \"kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.188795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.188359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.188795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.188414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.188900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.188803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.188900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.188839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.197524 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.197499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxnq\" (UniqueName: \"kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.289628 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.289555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:14.411285 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:14.411256    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"]
Jul 21 16:29:14.414586 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:29:14.414556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6eb04a_db19_410f_b8c6_78b7ee030a36.slice/crio-12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8 WatchSource:0}: Error finding container 12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8: Status 404 returned error can't find the container with id 12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8
Jul 21 16:29:15.070556 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:15.070518    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerID="ec979eb819249906d675a4478ef3fed684891010e129ce80d7bdf5d3b8307ebe" exitCode=0
Jul 21 16:29:15.070724 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:15.070579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf" event={"ID":"1c6eb04a-db19-410f-b8c6-78b7ee030a36","Type":"ContainerDied","Data":"ec979eb819249906d675a4478ef3fed684891010e129ce80d7bdf5d3b8307ebe"}
Jul 21 16:29:15.070724 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:15.070619    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf" event={"ID":"1c6eb04a-db19-410f-b8c6-78b7ee030a36","Type":"ContainerStarted","Data":"12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8"}
Jul 21 16:29:15.532353 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:15.532305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:15.730371 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:15.730337    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:18.084151 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:18.084122    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerID="f41ab8750887f6055afcf8416f24a5ae33992f49fb340366d6086e96a83fef0a" exitCode=0
Jul 21 16:29:18.084546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:18.084175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf" event={"ID":"1c6eb04a-db19-410f-b8c6-78b7ee030a36","Type":"ContainerDied","Data":"f41ab8750887f6055afcf8416f24a5ae33992f49fb340366d6086e96a83fef0a"}
Jul 21 16:29:18.506089 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:18.506037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:18.570736 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:18.570704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:19.090477 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:19.090444    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerID="f9f6bca251345ae557243b0daeca5fb1108e58adea1b2344fe900be39617d152" exitCode=0
Jul 21 16:29:19.090833 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:19.090510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf" event={"ID":"1c6eb04a-db19-410f-b8c6-78b7ee030a36","Type":"ContainerDied","Data":"f9f6bca251345ae557243b0daeca5fb1108e58adea1b2344fe900be39617d152"}
Jul 21 16:29:20.215804 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.215782    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:20.336381 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.336352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djxnq\" (UniqueName: \"kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq\") pod \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") "
Jul 21 16:29:20.336517 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.336391    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util\") pod \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") "
Jul 21 16:29:20.336517 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.336409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle\") pod \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\" (UID: \"1c6eb04a-db19-410f-b8c6-78b7ee030a36\") "
Jul 21 16:29:20.336764 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.336741    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle" (OuterVolumeSpecName: "bundle") pod "1c6eb04a-db19-410f-b8c6-78b7ee030a36" (UID: "1c6eb04a-db19-410f-b8c6-78b7ee030a36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:20.338388 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.338365    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq" (OuterVolumeSpecName: "kube-api-access-djxnq") pod "1c6eb04a-db19-410f-b8c6-78b7ee030a36" (UID: "1c6eb04a-db19-410f-b8c6-78b7ee030a36"). InnerVolumeSpecName "kube-api-access-djxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:20.341092 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.341067    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util" (OuterVolumeSpecName: "util") pod "1c6eb04a-db19-410f-b8c6-78b7ee030a36" (UID: "1c6eb04a-db19-410f-b8c6-78b7ee030a36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:20.437369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.437339    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djxnq\" (UniqueName: \"kubernetes.io/projected/1c6eb04a-db19-410f-b8c6-78b7ee030a36-kube-api-access-djxnq\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.437369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.437365    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:20.437369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:20.437375    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6eb04a-db19-410f-b8c6-78b7ee030a36-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:21.098299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:21.098263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf" event={"ID":"1c6eb04a-db19-410f-b8c6-78b7ee030a36","Type":"ContainerDied","Data":"12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8"}
Jul 21 16:29:21.098299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:21.098293    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9vddf"
Jul 21 16:29:21.098516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:21.098355    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12fff6bf09c3d68a4ecfc5424e83df92fca05cfe6ac9545e75a07253c01ef0c8"
Jul 21 16:29:21.137649 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:21.137625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:21.189439 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:21.189408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:23.135866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.135838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:23.824760 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.824728    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lj424"]
Jul 21 16:29:23.825047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825031    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="extract"
Jul 21 16:29:23.825123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825051    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="extract"
Jul 21 16:29:23.825123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825078    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="pull"
Jul 21 16:29:23.825123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825087    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="pull"
Jul 21 16:29:23.825123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825099    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="util"
Jul 21 16:29:23.825123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825107    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="util"
Jul 21 16:29:23.825371 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.825170    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c6eb04a-db19-410f-b8c6-78b7ee030a36" containerName="extract"
Jul 21 16:29:23.828045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.828026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:23.830809 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.830790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 16:29:23.831079 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.831065    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 16:29:23.832214 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.832194    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hp7ss\""
Jul 21 16:29:23.838710 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.838690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lj424"]
Jul 21 16:29:23.964076 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.964036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-bound-sa-token\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:23.964076 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:23.964081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4cl\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-kube-api-access-2v4cl\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.065379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.065339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-bound-sa-token\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.065502 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.065412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4cl\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-kube-api-access-2v4cl\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.073725 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.073701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-bound-sa-token\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.074029 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.074011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4cl\" (UniqueName: \"kubernetes.io/projected/5cc94c1b-dfc3-4f6a-9fab-e398076b8c49-kube-api-access-2v4cl\") pod \"cert-manager-55b4d954d5-lj424\" (UID: \"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49\") " pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.137287 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.137260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lj424"
Jul 21 16:29:24.258412 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:24.258387    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lj424"]
Jul 21 16:29:24.260707 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:29:24.260680    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc94c1b_dfc3_4f6a_9fab_e398076b8c49.slice/crio-75165515d3a42627cac7e3b838056c8231910d36764fba65a2b936344e2a8515 WatchSource:0}: Error finding container 75165515d3a42627cac7e3b838056c8231910d36764fba65a2b936344e2a8515: Status 404 returned error can't find the container with id 75165515d3a42627cac7e3b838056c8231910d36764fba65a2b936344e2a8515
Jul 21 16:29:25.111648 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:25.111618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lj424" event={"ID":"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49","Type":"ContainerStarted","Data":"75165515d3a42627cac7e3b838056c8231910d36764fba65a2b936344e2a8515"}
Jul 21 16:29:25.768478 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:25.768443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:25.876018 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:25.875949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:27.515065 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.515033    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"]
Jul 21 16:29:27.517041 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.517026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.519985 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.519962    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:29:27.521256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.521237    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:29:27.521340 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.521250    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gkxh4\""
Jul 21 16:29:27.526807 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.526774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"]
Jul 21 16:29:27.695071 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.694979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcf5v\" (UniqueName: \"kubernetes.io/projected/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-kube-api-access-kcf5v\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.695071 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.695026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.796236 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.796203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.796425 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.796293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcf5v\" (UniqueName: \"kubernetes.io/projected/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-kube-api-access-kcf5v\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.796644 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.796624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.805128 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.805105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcf5v\" (UniqueName: \"kubernetes.io/projected/a6272888-ee5e-4832-8b7c-c5ec75e3a6d3-kube-api-access-kcf5v\") pod \"openshift-lws-operator-fd8ccff4c-wtvvd\" (UID: \"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.826206 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.826185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"
Jul 21 16:29:27.949540 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:27.949514    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd"]
Jul 21 16:29:27.951864 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:29:27.951838    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6272888_ee5e_4832_8b7c_c5ec75e3a6d3.slice/crio-e24600078faada25cc4425039063d8bba8826e6d1b1879418ec24b098d5676f6 WatchSource:0}: Error finding container e24600078faada25cc4425039063d8bba8826e6d1b1879418ec24b098d5676f6: Status 404 returned error can't find the container with id e24600078faada25cc4425039063d8bba8826e6d1b1879418ec24b098d5676f6
Jul 21 16:29:28.124754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:28.124716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd" event={"ID":"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3","Type":"ContainerStarted","Data":"e24600078faada25cc4425039063d8bba8826e6d1b1879418ec24b098d5676f6"}
Jul 21 16:29:28.126112 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:28.126089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lj424" event={"ID":"5cc94c1b-dfc3-4f6a-9fab-e398076b8c49","Type":"ContainerStarted","Data":"d0163cda7743c679024f46b9b97c9359efdc2db3f2b289c517d83c219751c6c9"}
Jul 21 16:29:28.143390 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:28.143347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lj424" podStartSLOduration=2.041347163 podStartE2EDuration="5.143335213s" totalImagesPullingTime="3.10198805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:28.142326988 +0000 UTC m=+268.594882191" watchObservedRunningTime="2026-07-21 16:29:28.143335213 +0000 UTC m=+268.595890422"
Jul 21 16:29:30.135395 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:30.135360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd" event={"ID":"a6272888-ee5e-4832-8b7c-c5ec75e3a6d3","Type":"ContainerStarted","Data":"6931b4bac409920bf063630a6fdc07e977061ca4c1be6819df869d1ff95df96e"}
Jul 21 16:29:30.152489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:30.152432    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wtvvd" podStartSLOduration=1.5439901470000001 podStartE2EDuration="3.152418205s" totalImagesPullingTime="1.608428058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:30.151217108 +0000 UTC m=+270.603772332" watchObservedRunningTime="2026-07-21 16:29:30.152418205 +0000 UTC m=+270.604973417"
Jul 21 16:29:30.836958 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:30.836917    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:30.937276 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:30.937246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.657633 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.657596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:32.812241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.812210    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"]
Jul 21 16:29:32.816022 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.816005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:32.818898 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.818878    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:29:32.819003 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.818880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bwrp2\""
Jul 21 16:29:32.819003 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.818920    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:29:32.824129 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.824109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"]
Jul 21 16:29:32.935266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.935195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:32.935266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.935242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zq4\" (UniqueName: \"kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:32.935480 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:32.935278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.036623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.036587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.036830 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.036640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.036830 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.036690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zq4\" (UniqueName: \"kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.037062 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.037045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.037104 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.037057    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.045225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.045201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zq4\" (UniqueName: \"kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.125556 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.125527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:33.258057 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.258030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"]
Jul 21 16:29:33.259736 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:29:33.259710    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77d972f_1ca1_4f87_89db_e3897911ed8d.slice/crio-e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25 WatchSource:0}: Error finding container e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25: Status 404 returned error can't find the container with id e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25
Jul 21 16:29:33.348416 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:33.348385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:34.152281 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:34.152245    2577 generic.go:356] "Generic (PLEG): container finished" podID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerID="30cd4b6f506b52cb91515f008e64dd8e047be9f5a3b7df25b0d683508a4305f6" exitCode=0
Jul 21 16:29:34.152655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:34.152297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs" event={"ID":"a77d972f-1ca1-4f87-89db-e3897911ed8d","Type":"ContainerDied","Data":"30cd4b6f506b52cb91515f008e64dd8e047be9f5a3b7df25b0d683508a4305f6"}
Jul 21 16:29:34.152655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:34.152354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs" event={"ID":"a77d972f-1ca1-4f87-89db-e3897911ed8d","Type":"ContainerStarted","Data":"e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25"}
Jul 21 16:29:36.161592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:36.161552    2577 generic.go:356] "Generic (PLEG): container finished" podID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerID="c49f8c3ae60fcefc9121c79cef3ffa64eb6fbbe6bb0b660c5e491c77588ebabf" exitCode=0
Jul 21 16:29:36.161592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:36.161595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs" event={"ID":"a77d972f-1ca1-4f87-89db-e3897911ed8d","Type":"ContainerDied","Data":"c49f8c3ae60fcefc9121c79cef3ffa64eb6fbbe6bb0b660c5e491c77588ebabf"}
Jul 21 16:29:37.167258 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:37.167225    2577 generic.go:356] "Generic (PLEG): container finished" podID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerID="285ffcb0b33d43066583a38655cb23910d4a3ec316b54bed12dbe605f4f42927" exitCode=0
Jul 21 16:29:37.167648 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:37.167336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs" event={"ID":"a77d972f-1ca1-4f87-89db-e3897911ed8d","Type":"ContainerDied","Data":"285ffcb0b33d43066583a38655cb23910d4a3ec316b54bed12dbe605f4f42927"}
Jul 21 16:29:38.296481 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.296458    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:38.370989 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.370954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util\") pod \"a77d972f-1ca1-4f87-89db-e3897911ed8d\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") "
Jul 21 16:29:38.371149 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.371002    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2zq4\" (UniqueName: \"kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4\") pod \"a77d972f-1ca1-4f87-89db-e3897911ed8d\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") "
Jul 21 16:29:38.373014 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.372985    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4" (OuterVolumeSpecName: "kube-api-access-v2zq4") pod "a77d972f-1ca1-4f87-89db-e3897911ed8d" (UID: "a77d972f-1ca1-4f87-89db-e3897911ed8d"). InnerVolumeSpecName "kube-api-access-v2zq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:29:38.376066 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.376042    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util" (OuterVolumeSpecName: "util") pod "a77d972f-1ca1-4f87-89db-e3897911ed8d" (UID: "a77d972f-1ca1-4f87-89db-e3897911ed8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:38.472086 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.472004    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle\") pod \"a77d972f-1ca1-4f87-89db-e3897911ed8d\" (UID: \"a77d972f-1ca1-4f87-89db-e3897911ed8d\") "
Jul 21 16:29:38.472247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.472138    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:38.472247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.472150    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2zq4\" (UniqueName: \"kubernetes.io/projected/a77d972f-1ca1-4f87-89db-e3897911ed8d-kube-api-access-v2zq4\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:38.472764 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.472738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle" (OuterVolumeSpecName: "bundle") pod "a77d972f-1ca1-4f87-89db-e3897911ed8d" (UID: "a77d972f-1ca1-4f87-89db-e3897911ed8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:29:38.572528 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:38.572486    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77d972f-1ca1-4f87-89db-e3897911ed8d-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:29:39.176470 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:39.176436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs" event={"ID":"a77d972f-1ca1-4f87-89db-e3897911ed8d","Type":"ContainerDied","Data":"e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25"}
Jul 21 16:29:39.176470 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:39.176467    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkg5bs"
Jul 21 16:29:39.176470 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:39.176483    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e183696bc782d518262e205d97e4bf940bd82d1a8f719f72abaff5bd3aa69d25"
Jul 21 16:29:41.099625 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:41.099589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:50.165963 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:50.165923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.092166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092129    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"]
Jul 21 16:29:51.092441 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092427    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="extract"
Jul 21 16:29:51.092493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092442    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="extract"
Jul 21 16:29:51.092493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092452    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="util"
Jul 21 16:29:51.092493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092461    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="util"
Jul 21 16:29:51.092493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092483    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="pull"
Jul 21 16:29:51.092493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092489    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="pull"
Jul 21 16:29:51.092638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.092534    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77d972f-1ca1-4f87-89db-e3897911ed8d" containerName="extract"
Jul 21 16:29:51.094270 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.094255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.098625 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.098604    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:29:51.098746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.098656    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:29:51.099140 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.099117    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:29:51.099246 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.099163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dmv6\""
Jul 21 16:29:51.099682 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.099663    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:29:51.113912 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.113888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"]
Jul 21 16:29:51.155217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.155188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfwl\" (UniqueName: \"kubernetes.io/projected/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-kube-api-access-rnfwl\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.155368 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.155229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.155368 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.155268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.155368 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.155320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.155368 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.155344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256203 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfwl\" (UniqueName: \"kubernetes.io/projected/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-kube-api-access-rnfwl\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.256747 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.256698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.258546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.258525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.258634 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.258607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.258748 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.258729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.269685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.269666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfwl\" (UniqueName: \"kubernetes.io/projected/b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2-kube-api-access-rnfwl\") pod \"opendatahub-operator-controller-manager-7d658cff7b-2jcxw\" (UID: \"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.399975 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.399943    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.403936 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.403918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:51.500810 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.500782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.547984 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.547961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"]
Jul 21 16:29:51.550607 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:29:51.550585    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58f88a8_4b5a_4bdc_a3a1_92bcdad2c5c2.slice/crio-1658559af7dec5178858a1944ff16b675343b498572f0c1bd61fb40a74df48f1 WatchSource:0}: Error finding container 1658559af7dec5178858a1944ff16b675343b498572f0c1bd61fb40a74df48f1: Status 404 returned error can't find the container with id 1658559af7dec5178858a1944ff16b675343b498572f0c1bd61fb40a74df48f1
Jul 21 16:29:51.731505 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.731435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:51.883433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:51.883397    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:52.225753 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:52.225682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw" event={"ID":"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2","Type":"ContainerStarted","Data":"1658559af7dec5178858a1944ff16b675343b498572f0c1bd61fb40a74df48f1"}
Jul 21 16:29:53.359124 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:53.359085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:53.458017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:53.457978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:29:55.239458 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:55.239422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw" event={"ID":"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2","Type":"ContainerStarted","Data":"05d41fc8b751c101b7f61554094cb6db7216888dcd5427156fa4e35bf9905668"}
Jul 21 16:29:56.245466 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:56.245426    2577 generic.go:356] "Generic (PLEG): container finished" podID="b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2" containerID="05d41fc8b751c101b7f61554094cb6db7216888dcd5427156fa4e35bf9905668" exitCode=0
Jul 21 16:29:56.245853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:56.245478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw" event={"ID":"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2","Type":"ContainerDied","Data":"05d41fc8b751c101b7f61554094cb6db7216888dcd5427156fa4e35bf9905668"}
Jul 21 16:29:57.251594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:57.251563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw" event={"ID":"b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2","Type":"ContainerStarted","Data":"a34aa6d2f4499d35ae8752a59f565bf7a072eb3433e91d1078721e83fee8f3b3"}
Jul 21 16:29:57.252055 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:57.251698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:29:57.278692 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:57.278650    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw" podStartSLOduration=1.839142871 podStartE2EDuration="6.278635674s" totalImagesPullingTime="3.395219887s" totalInitContainerRuntime="1.044272916s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:57.27634988 +0000 UTC m=+297.728905092" watchObservedRunningTime="2026-07-21 16:29:57.278635674 +0000 UTC m=+297.731190890"
Jul 21 16:29:59.986456 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:29:59.986428    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:30:02.686219 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:02.686178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:02.787683 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:02.787655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:03.641152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:03.641110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:03.755244 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:03.755203    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:06.284326 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:06.284272    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:06.387328 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:06.387267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:06.719905 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:06.719870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:08.258150 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:08.258122    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-2jcxw"
Jul 21 16:30:10.175211 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.175173    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:10.715476 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.715444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:10.878706 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.878678    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxqpw"]
Jul 21 16:30:10.881241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.881223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:10.883851 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.883828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 16:30:10.883954 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.883859    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dttmg\""
Jul 21 16:30:10.892564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.892537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxqpw"]
Jul 21 16:30:10.916995 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:10.916963    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:11.015418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.015337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-cert\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.015418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.015374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrfz\" (UniqueName: \"kubernetes.io/projected/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-kube-api-access-zdrfz\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.026033 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.026007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:11.116236 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.116209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-cert\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.116374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.116241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrfz\" (UniqueName: \"kubernetes.io/projected/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-kube-api-access-zdrfz\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.118568 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.118549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-cert\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.119848 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.119827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:11.137974 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.137953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrfz\" (UniqueName: \"kubernetes.io/projected/2d8b8ac1-b90d-4e00-9761-1b71d53064b4-kube-api-access-zdrfz\") pod \"odh-model-controller-7998c67dc4-mxqpw\" (UID: \"2d8b8ac1-b90d-4e00-9761-1b71d53064b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.192797 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.192775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:11.223043 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.223013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:11.333417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.333383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxqpw"]
Jul 21 16:30:11.338333 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:30:11.338294    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8b8ac1_b90d_4e00_9761_1b71d53064b4.slice/crio-542ab5215eeb9b2709cdd05a2139b40e4878567263f3d557f9838481b2b2db84 WatchSource:0}: Error finding container 542ab5215eeb9b2709cdd05a2139b40e4878567263f3d557f9838481b2b2db84: Status 404 returned error can't find the container with id 542ab5215eeb9b2709cdd05a2139b40e4878567263f3d557f9838481b2b2db84
Jul 21 16:30:11.339502 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.339485    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:30:11.510876 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.510829    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:11.698621 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:11.698590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:12.314549 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:12.314481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw" event={"ID":"2d8b8ac1-b90d-4e00-9761-1b71d53064b4","Type":"ContainerStarted","Data":"542ab5215eeb9b2709cdd05a2139b40e4878567263f3d557f9838481b2b2db84"}
Jul 21 16:30:15.330578 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:15.330542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw" event={"ID":"2d8b8ac1-b90d-4e00-9761-1b71d53064b4","Type":"ContainerStarted","Data":"cb27f3a0198c8d8b83108ad96196408ec68a92a434cf6d85a29a1680d049dfe0"}
Jul 21 16:30:15.330994 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:15.330624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:15.351247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:15.351194    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw" podStartSLOduration=2.337836023 podStartE2EDuration="5.351181102s" totalImagesPullingTime="3.013345079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:15.350641331 +0000 UTC m=+315.803196544" watchObservedRunningTime="2026-07-21 16:30:15.351181102 +0000 UTC m=+315.803736318"
Jul 21 16:30:17.588371 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.588333    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"]
Jul 21 16:30:17.590402 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.590386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.594806 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.594785    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 16:30:17.594891 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.594857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 16:30:17.594934 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.594864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wql69\""
Jul 21 16:30:17.594975 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.594864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 16:30:17.601113 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.601092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"]
Jul 21 16:30:17.676862 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.676832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f16d14b3-6ced-4494-a7ac-86940341667e-manager-config\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.676862 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.676860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.677064 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.676900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.677064 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.676991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsx55\" (UniqueName: \"kubernetes.io/projected/f16d14b3-6ced-4494-a7ac-86940341667e-kube-api-access-xsx55\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.778130 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.778098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f16d14b3-6ced-4494-a7ac-86940341667e-manager-config\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.778292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.778132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.778292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.778190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.778292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.778233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsx55\" (UniqueName: \"kubernetes.io/projected/f16d14b3-6ced-4494-a7ac-86940341667e-kube-api-access-xsx55\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.778772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.778749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f16d14b3-6ced-4494-a7ac-86940341667e-manager-config\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.780502 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.780484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.780612 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.780595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f16d14b3-6ced-4494-a7ac-86940341667e-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.787241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.787218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsx55\" (UniqueName: \"kubernetes.io/projected/f16d14b3-6ced-4494-a7ac-86940341667e-kube-api-access-xsx55\") pod \"lws-controller-manager-76fbb8f576-ktsb4\" (UID: \"f16d14b3-6ced-4494-a7ac-86940341667e\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:17.900170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:17.900137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:18.023041 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:18.022975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"]
Jul 21 16:30:18.025105 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:30:18.025087    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16d14b3_6ced_4494_a7ac_86940341667e.slice/crio-b5cd67ef1b16cb5d0f0f6862eaa79a97bf40d6bf6757cb81cb0fe4258e89455e WatchSource:0}: Error finding container b5cd67ef1b16cb5d0f0f6862eaa79a97bf40d6bf6757cb81cb0fe4258e89455e: Status 404 returned error can't find the container with id b5cd67ef1b16cb5d0f0f6862eaa79a97bf40d6bf6757cb81cb0fe4258e89455e
Jul 21 16:30:18.344963 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:18.344877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4" event={"ID":"f16d14b3-6ced-4494-a7ac-86940341667e","Type":"ContainerStarted","Data":"b5cd67ef1b16cb5d0f0f6862eaa79a97bf40d6bf6757cb81cb0fe4258e89455e"}
Jul 21 16:30:20.354553 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.354518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4" event={"ID":"f16d14b3-6ced-4494-a7ac-86940341667e","Type":"ContainerStarted","Data":"e5c0fabe891397e53e934d32955165385d86382f50b3fa52c0689ea17edff620"}
Jul 21 16:30:20.354968 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.354585    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:20.377380 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.377322    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4" podStartSLOduration=1.859534102 podStartE2EDuration="3.377291938s" totalImagesPullingTime="1.517757836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:20.375908995 +0000 UTC m=+320.828464208" watchObservedRunningTime="2026-07-21 16:30:20.377291938 +0000 UTC m=+320.829847149"
Jul 21 16:30:20.465203 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.465163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:20.563540 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.563508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:20.712290 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.712253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:20.842404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:20.842366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:21.034534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:21.034443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:21.750775 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:21.750741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:22.025977 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:22.025892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:22.127058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:22.127022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:23.194266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:23.194229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:23.319721 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:23.319683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:25.184655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:25.184620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:25.296992 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:25.296952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:25.383909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:25.383874    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:26.337323 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:26.337281    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mxqpw"
Jul 21 16:30:27.640900 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:27.640864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:27.741481 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:27.741446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:28.278635 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.278605    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"]
Jul 21 16:30:28.284110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.284082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:28.286894 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.286875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.289908 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.289884    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lt9rr\""
Jul 21 16:30:28.290006 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.289938    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:30:28.290067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.290004    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:30:28.291029 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.291011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:30:28.299544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.299526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"]
Jul 21 16:30:28.367976 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.367943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a757c50-2703-44d5-8e37-8163b50ac236-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368115 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.367987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a757c50-2703-44d5-8e37-8163b50ac236-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368115 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbgv\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-kube-api-access-wtbgv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368380 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.368380 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.368249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469605 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a757c50-2703-44d5-8e37-8163b50ac236-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a757c50-2703-44d5-8e37-8163b50ac236-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbgv\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-kube-api-access-wtbgv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.469787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.469845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470207 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.470116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470258 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.470238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470372 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.470352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470440 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.470369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.470569 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.470550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a757c50-2703-44d5-8e37-8163b50ac236-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.472064 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.472044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a757c50-2703-44d5-8e37-8163b50ac236-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.472272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.472253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a757c50-2703-44d5-8e37-8163b50ac236-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.477638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.477616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.478134 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.478109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbgv\" (UniqueName: \"kubernetes.io/projected/0a757c50-2703-44d5-8e37-8163b50ac236-kube-api-access-wtbgv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46gcwv\" (UID: \"0a757c50-2703-44d5-8e37-8163b50ac236\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.500426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.500360    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:28.596417 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.596328    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:28.639486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.639447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:28.723792 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:28.723749    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"]
Jul 21 16:30:28.726003 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:30:28.725977    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a757c50_2703_44d5_8e37_8163b50ac236.slice/crio-c4a069f9978adf4941542fa0d75ea6d26269e414003fbd4cf517987989f7f08a WatchSource:0}: Error finding container c4a069f9978adf4941542fa0d75ea6d26269e414003fbd4cf517987989f7f08a: Status 404 returned error can't find the container with id c4a069f9978adf4941542fa0d75ea6d26269e414003fbd4cf517987989f7f08a
Jul 21 16:30:29.395246 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:29.395211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv" event={"ID":"0a757c50-2703-44d5-8e37-8163b50ac236","Type":"ContainerStarted","Data":"c4a069f9978adf4941542fa0d75ea6d26269e414003fbd4cf517987989f7f08a"}
Jul 21 16:30:31.362594 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:31.362559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-ktsb4"
Jul 21 16:30:31.532557 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:31.532523    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:30:31.532624 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:31.532596    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:30:31.532660 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:31.532629    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:30:32.412138 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:32.412109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv" event={"ID":"0a757c50-2703-44d5-8e37-8163b50ac236","Type":"ContainerStarted","Data":"bdba5cb2ea9efa7985780c21e17dc68613b0b3ecb82d8ec1719edc9cf1710943"}
Jul 21 16:30:32.596680 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:32.596646    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:32.600739 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:32.600719    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:32.621846 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:32.621804    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv" podStartSLOduration=1.817739892 podStartE2EDuration="4.621790343s" totalImagesPullingTime="2.804050451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:32.433499074 +0000 UTC m=+332.886054287" watchObservedRunningTime="2026-07-21 16:30:32.621790343 +0000 UTC m=+333.074345556"
Jul 21 16:30:33.417031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:33.416996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:33.417854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:33.417837    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46gcwv"
Jul 21 16:30:39.094488 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:39.094401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:40.943773 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:40.943731    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:30:41.005565 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:30:41.005501    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:11.559227 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.559142    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:11.649949 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.649918    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:11.700659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.700624    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:11.706503 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.706480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:11.709997 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.709973    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:31:11.710135 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.709999    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gxshr\""
Jul 21 16:31:11.711351 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.711330    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:31:11.718550 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.718524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:11.786954 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.786926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:11.802044 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.802023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrspz\" (UniqueName: \"kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz\") pod \"kuadrant-operator-catalog-gvzlc\" (UID: \"c4dbdea4-4895-47fe-978f-9c6a7ae1562b\") " pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:11.903073 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.903043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrspz\" (UniqueName: \"kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz\") pod \"kuadrant-operator-catalog-gvzlc\" (UID: \"c4dbdea4-4895-47fe-978f-9c6a7ae1562b\") " pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:11.912578 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:11.912547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrspz\" (UniqueName: \"kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz\") pod \"kuadrant-operator-catalog-gvzlc\" (UID: \"c4dbdea4-4895-47fe-978f-9c6a7ae1562b\") " pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:12.016375 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.016333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:12.061357 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.061302    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:12.141532 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.141512    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:12.143865 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:12.143838    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4dbdea4_4895_47fe_978f_9c6a7ae1562b.slice/crio-97ec877b62dbbca9a39f2994da51f5a75af324debf89f31f22fc136ead45b0bf WatchSource:0}: Error finding container 97ec877b62dbbca9a39f2994da51f5a75af324debf89f31f22fc136ead45b0bf: Status 404 returned error can't find the container with id 97ec877b62dbbca9a39f2994da51f5a75af324debf89f31f22fc136ead45b0bf
Jul 21 16:31:12.270273 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.270200    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5n6v"]
Jul 21 16:31:12.273266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.273251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:12.282357 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.282335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5n6v"]
Jul 21 16:31:12.407974 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.407941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmqm\" (UniqueName: \"kubernetes.io/projected/f796d933-443c-4a4d-a90b-a25617f1e9c3-kube-api-access-ttmqm\") pod \"kuadrant-operator-catalog-g5n6v\" (UID: \"f796d933-443c-4a4d-a90b-a25617f1e9c3\") " pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:12.508446 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.508409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmqm\" (UniqueName: \"kubernetes.io/projected/f796d933-443c-4a4d-a90b-a25617f1e9c3-kube-api-access-ttmqm\") pod \"kuadrant-operator-catalog-g5n6v\" (UID: \"f796d933-443c-4a4d-a90b-a25617f1e9c3\") " pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:12.516772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.516746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmqm\" (UniqueName: \"kubernetes.io/projected/f796d933-443c-4a4d-a90b-a25617f1e9c3-kube-api-access-ttmqm\") pod \"kuadrant-operator-catalog-g5n6v\" (UID: \"f796d933-443c-4a4d-a90b-a25617f1e9c3\") " pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:12.581705 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.581633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" event={"ID":"c4dbdea4-4895-47fe-978f-9c6a7ae1562b","Type":"ContainerStarted","Data":"97ec877b62dbbca9a39f2994da51f5a75af324debf89f31f22fc136ead45b0bf"}
Jul 21 16:31:12.583194 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.583171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:12.709055 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:12.709029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5n6v"]
Jul 21 16:31:12.711065 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:12.711039    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf796d933_443c_4a4d_a90b_a25617f1e9c3.slice/crio-8c0ab6b0bec9d3259ca3b981873177b5a9e048ee7166e7d95803e186c48fe983 WatchSource:0}: Error finding container 8c0ab6b0bec9d3259ca3b981873177b5a9e048ee7166e7d95803e186c48fe983: Status 404 returned error can't find the container with id 8c0ab6b0bec9d3259ca3b981873177b5a9e048ee7166e7d95803e186c48fe983
Jul 21 16:31:13.588849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:13.588814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v" event={"ID":"f796d933-443c-4a4d-a90b-a25617f1e9c3","Type":"ContainerStarted","Data":"8c0ab6b0bec9d3259ca3b981873177b5a9e048ee7166e7d95803e186c48fe983"}
Jul 21 16:31:14.595710 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.595668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" event={"ID":"c4dbdea4-4895-47fe-978f-9c6a7ae1562b","Type":"ContainerStarted","Data":"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"}
Jul 21 16:31:14.596149 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.595676    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" podUID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" containerName="registry-server" containerID="cri-o://7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c" gracePeriod=2
Jul 21 16:31:14.597617 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.597578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v" event={"ID":"f796d933-443c-4a4d-a90b-a25617f1e9c3","Type":"ContainerStarted","Data":"bec242661838f6f194f2ec3f7dd1774c44c6bb7b2e3efda6bc56183291f304ff"}
Jul 21 16:31:14.617032 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.616974    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" podStartSLOduration=1.251989579 podStartE2EDuration="3.616959377s" totalImagesPullingTime="2.364969798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:14.615264954 +0000 UTC m=+375.067820166" watchObservedRunningTime="2026-07-21 16:31:14.616959377 +0000 UTC m=+375.069514588"
Jul 21 16:31:14.633928 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.633870    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v" podStartSLOduration=0.846071141 podStartE2EDuration="2.633850425s" totalImagesPullingTime="1.787779284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:14.632841252 +0000 UTC m=+375.085396669" watchObservedRunningTime="2026-07-21 16:31:14.633850425 +0000 UTC m=+375.086405638"
Jul 21 16:31:14.837511 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.837489    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gvzlc_c4dbdea4-4895-47fe-978f-9c6a7ae1562b/registry-server/0.log"
Jul 21 16:31:14.839072 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.839056    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:14.930808 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.930774    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrspz\" (UniqueName: \"kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz\") pod \"c4dbdea4-4895-47fe-978f-9c6a7ae1562b\" (UID: \"c4dbdea4-4895-47fe-978f-9c6a7ae1562b\") "
Jul 21 16:31:14.932894 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:14.932866    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz" (OuterVolumeSpecName: "kube-api-access-xrspz") pod "c4dbdea4-4895-47fe-978f-9c6a7ae1562b" (UID: "c4dbdea4-4895-47fe-978f-9c6a7ae1562b"). InnerVolumeSpecName "kube-api-access-xrspz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:15.032352 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.032249    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrspz\" (UniqueName: \"kubernetes.io/projected/c4dbdea4-4895-47fe-978f-9c6a7ae1562b-kube-api-access-xrspz\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:15.603117 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603083    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gvzlc_c4dbdea4-4895-47fe-978f-9c6a7ae1562b/registry-server/0.log"
Jul 21 16:31:15.603593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603123    2577 generic.go:356] "Generic (PLEG): container finished" podID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" containerID="7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c" exitCode=2
Jul 21 16:31:15.603593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603199    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc"
Jul 21 16:31:15.603593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" event={"ID":"c4dbdea4-4895-47fe-978f-9c6a7ae1562b","Type":"ContainerDied","Data":"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"}
Jul 21 16:31:15.603593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gvzlc" event={"ID":"c4dbdea4-4895-47fe-978f-9c6a7ae1562b","Type":"ContainerDied","Data":"97ec877b62dbbca9a39f2994da51f5a75af324debf89f31f22fc136ead45b0bf"}
Jul 21 16:31:15.603593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.603284    2577 scope.go:117] "RemoveContainer" containerID="7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"
Jul 21 16:31:15.611468 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.611450    2577 scope.go:117] "RemoveContainer" containerID="7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"
Jul 21 16:31:15.611730 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:31:15.611704    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c\": container with ID starting with 7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c not found: ID does not exist" containerID="7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"
Jul 21 16:31:15.611795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.611739    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c"} err="failed to get container status \"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c\": rpc error: code = NotFound desc = could not find container \"7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c\": container with ID starting with 7767d7c03fd70cf0f0062b7a0da9e8844cbe81bd8062936ce72bccb186e84f2c not found: ID does not exist"
Jul 21 16:31:15.625051 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.625026    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:15.628458 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:15.628441    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gvzlc"]
Jul 21 16:31:16.106402 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:16.106366    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" path="/var/lib/kubelet/pods/c4dbdea4-4895-47fe-978f-9c6a7ae1562b/volumes"
Jul 21 16:31:22.583925 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:22.583881    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:22.584373 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:22.583964    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:22.606589 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:22.606561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:22.654450 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:22.654419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-g5n6v"
Jul 21 16:31:27.066172 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.066134    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"]
Jul 21 16:31:27.066549 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.066434    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" containerName="registry-server"
Jul 21 16:31:27.066549 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.066446    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" containerName="registry-server"
Jul 21 16:31:27.066549 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.066499    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4dbdea4-4895-47fe-978f-9c6a7ae1562b" containerName="registry-server"
Jul 21 16:31:27.068518 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.068502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.071234 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.071217    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tztzv\""
Jul 21 16:31:27.077976 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.077840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"]
Jul 21 16:31:27.231844 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.231810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.231844 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.231840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.232041 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.231869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4g8t\" (UniqueName: \"kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.333404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.333288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.333404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.333350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.333404 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.333385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4g8t\" (UniqueName: \"kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.333677 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.333657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.333711 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.333677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.342613 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.342585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4g8t\" (UniqueName: \"kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.378580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.378551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:27.520495 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.520468    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"]
Jul 21 16:31:27.522351 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:27.522324    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3b0013_20fb_47d3_a1e5_9b109b6ddc63.slice/crio-88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83 WatchSource:0}: Error finding container 88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83: Status 404 returned error can't find the container with id 88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83
Jul 21 16:31:27.654449 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.654419    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerID="6135c5c5e4da8aa088e02f982cd6360986631cf2e48451c1e05ba8d936bf4626" exitCode=0
Jul 21 16:31:27.654580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.654483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg" event={"ID":"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63","Type":"ContainerDied","Data":"6135c5c5e4da8aa088e02f982cd6360986631cf2e48451c1e05ba8d936bf4626"}
Jul 21 16:31:27.654580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.654518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg" event={"ID":"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63","Type":"ContainerStarted","Data":"88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83"}
Jul 21 16:31:27.666283 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.666253    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"]
Jul 21 16:31:27.668604 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.668582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.685910 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.685879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"]
Jul 21 16:31:27.837688 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.837653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79khh\" (UniqueName: \"kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.837918 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.837695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.837918 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.837806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.938223 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.938144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.938223 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.938195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79khh\" (UniqueName: \"kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.938223 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.938217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.938563 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.938545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.938621 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.938603    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.947305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.947286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79khh\" (UniqueName: \"kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:27.988824 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:27.988800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:28.115262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.115229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"]
Jul 21 16:31:28.120960 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:28.120934    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7610e1_d763_4b6d_9a1c_a042c8163037.slice/crio-91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06 WatchSource:0}: Error finding container 91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06: Status 404 returned error can't find the container with id 91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06
Jul 21 16:31:28.274567 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.274539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"]
Jul 21 16:31:28.277019 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.277005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.289271 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.289239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"]
Jul 21 16:31:28.441418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.441390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgd6r\" (UniqueName: \"kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.441596 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.441434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.441596 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.441471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.542306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.542206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgd6r\" (UniqueName: \"kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.542306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.542258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.542306 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.542281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.542679 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.542661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.542723 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.542676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.551195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.551166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgd6r\" (UniqueName: \"kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.585114 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.585091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:28.662195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.661168    2577 generic.go:356] "Generic (PLEG): container finished" podID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerID="7702d7848f5c247261fc653b32027da53ffc45311eabe88fb42708e49a5ef74f" exitCode=0
Jul 21 16:31:28.662195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.661331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p" event={"ID":"fe7610e1-d763-4b6d-9a1c-a042c8163037","Type":"ContainerDied","Data":"7702d7848f5c247261fc653b32027da53ffc45311eabe88fb42708e49a5ef74f"}
Jul 21 16:31:28.662195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.661387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p" event={"ID":"fe7610e1-d763-4b6d-9a1c-a042c8163037","Type":"ContainerStarted","Data":"91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06"}
Jul 21 16:31:28.673185 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.673160    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"]
Jul 21 16:31:28.676226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.676206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.691036 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.690850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"]
Jul 21 16:31:28.711426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.711399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"]
Jul 21 16:31:28.714581 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:28.714553    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb63530_ffe6_4d4d_a9ca_99d23752e458.slice/crio-0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e WatchSource:0}: Error finding container 0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e: Status 404 returned error can't find the container with id 0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e
Jul 21 16:31:28.844910 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.844880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.844910 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.844912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.845068 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.845000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wht\" (UniqueName: \"kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.946217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.946186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wht\" (UniqueName: \"kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.946386 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.946282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.946386 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.946320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.946646 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.946627    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.946684 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.946674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.955349 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.955324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wht\" (UniqueName: \"kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:28.989282 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:28.989256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:29.114873 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.114784    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"]
Jul 21 16:31:29.116950 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:29.116919    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d076b3b_2a0e_48a1_8dbb_c9969ad2a385.slice/crio-c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07 WatchSource:0}: Error finding container c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07: Status 404 returned error can't find the container with id c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07
Jul 21 16:31:29.667455 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.667419    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerID="7c26b2c9c39a48d554241811cb7a45db5d71021f5aad1200b351d6c10b9ead21" exitCode=0
Jul 21 16:31:29.667630 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.667495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg" event={"ID":"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63","Type":"ContainerDied","Data":"7c26b2c9c39a48d554241811cb7a45db5d71021f5aad1200b351d6c10b9ead21"}
Jul 21 16:31:29.669066 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.669047    2577 generic.go:356] "Generic (PLEG): container finished" podID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerID="11745a7e58dab07dc31d65e72901517679d9f821b756f0cbb3a015c7b94d121d" exitCode=0
Jul 21 16:31:29.669139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.669115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm" event={"ID":"edb63530-ffe6-4d4d-a9ca-99d23752e458","Type":"ContainerDied","Data":"11745a7e58dab07dc31d65e72901517679d9f821b756f0cbb3a015c7b94d121d"}
Jul 21 16:31:29.669199 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.669167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm" event={"ID":"edb63530-ffe6-4d4d-a9ca-99d23752e458","Type":"ContainerStarted","Data":"0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e"}
Jul 21 16:31:29.670760 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.670739    2577 generic.go:356] "Generic (PLEG): container finished" podID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerID="81376fbe3b53001fa1acbbb763c14ca18a87ecb04c2cf22d76c25a7045e66ef4" exitCode=0
Jul 21 16:31:29.670837 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.670793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z" event={"ID":"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385","Type":"ContainerDied","Data":"81376fbe3b53001fa1acbbb763c14ca18a87ecb04c2cf22d76c25a7045e66ef4"}
Jul 21 16:31:29.670837 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:29.670826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z" event={"ID":"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385","Type":"ContainerStarted","Data":"c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07"}
Jul 21 16:31:30.678551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:30.678519    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerID="a45596543121b30280c8437076b122c4f8569091ee229317859d58b6e5879cef" exitCode=0
Jul 21 16:31:30.678976 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:30.678609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg" event={"ID":"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63","Type":"ContainerDied","Data":"a45596543121b30280c8437076b122c4f8569091ee229317859d58b6e5879cef"}
Jul 21 16:31:31.687640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.687604    2577 generic.go:356] "Generic (PLEG): container finished" podID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerID="c243b872493ddd76604de8940eb489d2943668ed871b7234c863f875024aeccb" exitCode=0
Jul 21 16:31:31.688101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.687688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p" event={"ID":"fe7610e1-d763-4b6d-9a1c-a042c8163037","Type":"ContainerDied","Data":"c243b872493ddd76604de8940eb489d2943668ed871b7234c863f875024aeccb"}
Jul 21 16:31:31.689693 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.689661    2577 generic.go:356] "Generic (PLEG): container finished" podID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerID="aa35c46305028438a2303d5f3e2feacad3a1ebe052363fcc09d81f739a6d451d" exitCode=0
Jul 21 16:31:31.689823 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.689738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm" event={"ID":"edb63530-ffe6-4d4d-a9ca-99d23752e458","Type":"ContainerDied","Data":"aa35c46305028438a2303d5f3e2feacad3a1ebe052363fcc09d81f739a6d451d"}
Jul 21 16:31:31.826890 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.826870    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:31.975909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.975873    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle\") pod \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") "
Jul 21 16:31:31.976078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.975948    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util\") pod \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") "
Jul 21 16:31:31.976078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.976046    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4g8t\" (UniqueName: \"kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t\") pod \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\" (UID: \"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63\") "
Jul 21 16:31:31.976412 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.976381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle" (OuterVolumeSpecName: "bundle") pod "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" (UID: "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:31.978544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.978515    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t" (OuterVolumeSpecName: "kube-api-access-r4g8t") pod "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" (UID: "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63"). InnerVolumeSpecName "kube-api-access-r4g8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:31.982360 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:31.982336    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util" (OuterVolumeSpecName: "util") pod "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" (UID: "2c3b0013-20fb-47d3-a1e5-9b109b6ddc63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:32.077094 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.077061    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4g8t\" (UniqueName: \"kubernetes.io/projected/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-kube-api-access-r4g8t\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:32.077094 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.077089    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:32.077094 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.077101    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c3b0013-20fb-47d3-a1e5-9b109b6ddc63-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:32.696454 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.696413    2577 generic.go:356] "Generic (PLEG): container finished" podID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerID="4d5ba87e129d593f3acd0c175931eeea626618fcd30326355baa9ec12c6d3fb2" exitCode=0
Jul 21 16:31:32.696834 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.696493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm" event={"ID":"edb63530-ffe6-4d4d-a9ca-99d23752e458","Type":"ContainerDied","Data":"4d5ba87e129d593f3acd0c175931eeea626618fcd30326355baa9ec12c6d3fb2"}
Jul 21 16:31:32.698246 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.698222    2577 generic.go:356] "Generic (PLEG): container finished" podID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerID="10a6cd911bc6ae2f4dc9384185795f75f20338496900764feafb815db1583c44" exitCode=0
Jul 21 16:31:32.698348 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.698258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z" event={"ID":"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385","Type":"ContainerDied","Data":"10a6cd911bc6ae2f4dc9384185795f75f20338496900764feafb815db1583c44"}
Jul 21 16:31:32.700302 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.700285    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg"
Jul 21 16:31:32.700499 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.700283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg" event={"ID":"2c3b0013-20fb-47d3-a1e5-9b109b6ddc63","Type":"ContainerDied","Data":"88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83"}
Jul 21 16:31:32.700499 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.700425    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b7dc63ab8fcfe77bf96c58546b0415610714bfc2f00fe97caa4d5e48276a83"
Jul 21 16:31:32.702458 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.702431    2577 generic.go:356] "Generic (PLEG): container finished" podID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerID="7bf96369a88dd6f78c38e9480f6821b4dd9c4c310612917e1c3387dcc2c9b4ce" exitCode=0
Jul 21 16:31:32.702563 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:32.702467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p" event={"ID":"fe7610e1-d763-4b6d-9a1c-a042c8163037","Type":"ContainerDied","Data":"7bf96369a88dd6f78c38e9480f6821b4dd9c4c310612917e1c3387dcc2c9b4ce"}
Jul 21 16:31:33.710714 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.710682    2577 generic.go:356] "Generic (PLEG): container finished" podID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerID="3f0cb038e4c352e7de756c8cf44bbbed93a198afeff125a9f8716759ab41302d" exitCode=0
Jul 21 16:31:33.711095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.710733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z" event={"ID":"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385","Type":"ContainerDied","Data":"3f0cb038e4c352e7de756c8cf44bbbed93a198afeff125a9f8716759ab41302d"}
Jul 21 16:31:33.854391 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.854370    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:33.857042 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.857027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:33.994592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle\") pod \"edb63530-ffe6-4d4d-a9ca-99d23752e458\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") "
Jul 21 16:31:33.994592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgd6r\" (UniqueName: \"kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r\") pod \"edb63530-ffe6-4d4d-a9ca-99d23752e458\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") "
Jul 21 16:31:33.994592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79khh\" (UniqueName: \"kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh\") pod \"fe7610e1-d763-4b6d-9a1c-a042c8163037\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") "
Jul 21 16:31:33.994857 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle\") pod \"fe7610e1-d763-4b6d-9a1c-a042c8163037\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") "
Jul 21 16:31:33.994857 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994632    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util\") pod \"fe7610e1-d763-4b6d-9a1c-a042c8163037\" (UID: \"fe7610e1-d763-4b6d-9a1c-a042c8163037\") "
Jul 21 16:31:33.994857 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.994679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util\") pod \"edb63530-ffe6-4d4d-a9ca-99d23752e458\" (UID: \"edb63530-ffe6-4d4d-a9ca-99d23752e458\") "
Jul 21 16:31:33.995216 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.995159    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle" (OuterVolumeSpecName: "bundle") pod "fe7610e1-d763-4b6d-9a1c-a042c8163037" (UID: "fe7610e1-d763-4b6d-9a1c-a042c8163037"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:33.995361 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.995337    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle" (OuterVolumeSpecName: "bundle") pod "edb63530-ffe6-4d4d-a9ca-99d23752e458" (UID: "edb63530-ffe6-4d4d-a9ca-99d23752e458"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:33.997154 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.997123    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r" (OuterVolumeSpecName: "kube-api-access-dgd6r") pod "edb63530-ffe6-4d4d-a9ca-99d23752e458" (UID: "edb63530-ffe6-4d4d-a9ca-99d23752e458"). InnerVolumeSpecName "kube-api-access-dgd6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:33.997154 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.997137    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh" (OuterVolumeSpecName: "kube-api-access-79khh") pod "fe7610e1-d763-4b6d-9a1c-a042c8163037" (UID: "fe7610e1-d763-4b6d-9a1c-a042c8163037"). InnerVolumeSpecName "kube-api-access-79khh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:33.999612 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.999579    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util" (OuterVolumeSpecName: "util") pod "fe7610e1-d763-4b6d-9a1c-a042c8163037" (UID: "fe7610e1-d763-4b6d-9a1c-a042c8163037"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:33.999781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:33.999759    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util" (OuterVolumeSpecName: "util") pod "edb63530-ffe6-4d4d-a9ca-99d23752e458" (UID: "edb63530-ffe6-4d4d-a9ca-99d23752e458"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:34.096067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096035    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.096067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096060    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgd6r\" (UniqueName: \"kubernetes.io/projected/edb63530-ffe6-4d4d-a9ca-99d23752e458-kube-api-access-dgd6r\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.096067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096072    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79khh\" (UniqueName: \"kubernetes.io/projected/fe7610e1-d763-4b6d-9a1c-a042c8163037-kube-api-access-79khh\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.096272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096082    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.096272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096090    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe7610e1-d763-4b6d-9a1c-a042c8163037-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.096272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.096097    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/edb63530-ffe6-4d4d-a9ca-99d23752e458-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:34.717480 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.717450    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p"
Jul 21 16:31:34.717920 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.717447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p" event={"ID":"fe7610e1-d763-4b6d-9a1c-a042c8163037","Type":"ContainerDied","Data":"91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06"}
Jul 21 16:31:34.717920 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.717572    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91f5623442d98bb710f427d7feff53c170a640bb51b49169e37f293fcf95cb06"
Jul 21 16:31:34.719188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.719159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm" event={"ID":"edb63530-ffe6-4d4d-a9ca-99d23752e458","Type":"ContainerDied","Data":"0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e"}
Jul 21 16:31:34.719352 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.719195    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm"
Jul 21 16:31:34.719352 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.719201    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ccdd437e6bc9628c12aa8f83122ec6c6a4e517634cff4d5b2335785c7aa0e3e"
Jul 21 16:31:34.846776 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:34.846753    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:35.004087 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.003998    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle\") pod \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") "
Jul 21 16:31:35.004087 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.004075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util\") pod \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") "
Jul 21 16:31:35.004332 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.004140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9wht\" (UniqueName: \"kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht\") pod \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\" (UID: \"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385\") "
Jul 21 16:31:35.004659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.004630    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle" (OuterVolumeSpecName: "bundle") pod "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" (UID: "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:35.006731 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.006688    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht" (OuterVolumeSpecName: "kube-api-access-d9wht") pod "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" (UID: "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385"). InnerVolumeSpecName "kube-api-access-d9wht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:31:35.009825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.009799    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util" (OuterVolumeSpecName: "util") pod "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" (UID: "8d076b3b-2a0e-48a1-8dbb-c9969ad2a385"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:31:35.105344 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.105295    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-util\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:35.105344 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.105346    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9wht\" (UniqueName: \"kubernetes.io/projected/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-kube-api-access-d9wht\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:35.105510 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.105358    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d076b3b-2a0e-48a1-8dbb-c9969ad2a385-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:31:35.725765 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.725732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z" event={"ID":"8d076b3b-2a0e-48a1-8dbb-c9969ad2a385","Type":"ContainerDied","Data":"c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07"}
Jul 21 16:31:35.726110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.725779    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c85f32bed18b68f232ed64790860c44f86e40dcf54a1b35743676db11f11ad07"
Jul 21 16:31:35.726110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:35.725777    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z"
Jul 21 16:31:36.279748 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.279716    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db8fb776-wklfc"]
Jul 21 16:31:36.280001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.279990    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="pull"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280003    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="pull"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280012    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="extract"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280018    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="extract"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="util"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280031    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="util"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280037    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="extract"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280042    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="extract"
Jul 21 16:31:36.280049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280051    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280056    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280062    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280067    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280074    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280079    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280088    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280093    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280100    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280105    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="pull"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280113    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280117    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280122    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280126    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="util"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280132    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280137    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280194    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb63530-ffe6-4d4d-a9ca-99d23752e458" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280203    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3b0013-20fb-47d3-a1e5-9b109b6ddc63" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280210    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d076b3b-2a0e-48a1-8dbb-c9969ad2a385" containerName="extract"
Jul 21 16:31:36.280299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.280215    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7610e1-d763-4b6d-9a1c-a042c8163037" containerName="extract"
Jul 21 16:31:36.283988 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.283972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.294583 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.294562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db8fb776-wklfc"]
Jul 21 16:31:36.340903 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.340857    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.407423 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.407374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.416492 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416598 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-oauth-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416598 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt87m\" (UniqueName: \"kubernetes.io/projected/0da5dfa7-a870-4696-91c4-ea1113c08ab1-kube-api-access-pt87m\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-trusted-ca-bundle\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-service-ca\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.416848 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.416740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-oauth-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.475744 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.475711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.517933 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.517907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-service-ca\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.517970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.517993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-oauth-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518082 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518082 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-oauth-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518082 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt87m\" (UniqueName: \"kubernetes.io/projected/0da5dfa7-a870-4696-91c4-ea1113c08ab1-kube-api-access-pt87m\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518326 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-trusted-ca-bundle\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518667 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-service-ca\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518786 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.518893 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.518868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-oauth-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.519060 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.519043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0da5dfa7-a870-4696-91c4-ea1113c08ab1-trusted-ca-bundle\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.520442 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.520420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-oauth-config\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.520593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.520575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0da5dfa7-a870-4696-91c4-ea1113c08ab1-console-serving-cert\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.527613 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.527590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt87m\" (UniqueName: \"kubernetes.io/projected/0da5dfa7-a870-4696-91c4-ea1113c08ab1-kube-api-access-pt87m\") pod \"console-7db8fb776-wklfc\" (UID: \"0da5dfa7-a870-4696-91c4-ea1113c08ab1\") " pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.538084 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.538016    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:36.594620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.594590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:36.723228 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.723202    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db8fb776-wklfc"]
Jul 21 16:31:36.724412 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:36.724381    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da5dfa7_a870_4696_91c4_ea1113c08ab1.slice/crio-731b8c5c2e984b107be65a129cb65e9e037e192245eab9cc4e0c2abe95e9999b WatchSource:0}: Error finding container 731b8c5c2e984b107be65a129cb65e9e037e192245eab9cc4e0c2abe95e9999b: Status 404 returned error can't find the container with id 731b8c5c2e984b107be65a129cb65e9e037e192245eab9cc4e0c2abe95e9999b
Jul 21 16:31:36.731199 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:36.731174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8fb776-wklfc" event={"ID":"0da5dfa7-a870-4696-91c4-ea1113c08ab1","Type":"ContainerStarted","Data":"731b8c5c2e984b107be65a129cb65e9e037e192245eab9cc4e0c2abe95e9999b"}
Jul 21 16:31:37.154749 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:37.154710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.223070 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:37.223042    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:37.737606 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:37.737573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8fb776-wklfc" event={"ID":"0da5dfa7-a870-4696-91c4-ea1113c08ab1","Type":"ContainerStarted","Data":"718aaa057641fc39c6f2db5f1c1f89567d8cb571c2f1190f4bb529898c23d890"}
Jul 21 16:31:37.758137 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:37.758079    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db8fb776-wklfc" podStartSLOduration=1.758060749 podStartE2EDuration="1.758060749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:37.756924995 +0000 UTC m=+398.209480208" watchObservedRunningTime="2026-07-21 16:31:37.758060749 +0000 UTC m=+398.210615960"
Jul 21 16:31:40.412604 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:40.412560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:41.212652 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:41.212615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:44.424301 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.424268    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"]
Jul 21 16:31:44.428774 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.428758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:44.432796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.432776    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jgzxw\""
Jul 21 16:31:44.447684 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.447662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"]
Jul 21 16:31:44.481146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.481117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2fqz\" (UniqueName: \"kubernetes.io/projected/549832a5-fe7a-40f2-bf05-fa08e46f19d2-kube-api-access-c2fqz\") pod \"authorino-operator-75cc8d5cb7-lqx97\" (UID: \"549832a5-fe7a-40f2-bf05-fa08e46f19d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:44.582465 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.582427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2fqz\" (UniqueName: \"kubernetes.io/projected/549832a5-fe7a-40f2-bf05-fa08e46f19d2-kube-api-access-c2fqz\") pod \"authorino-operator-75cc8d5cb7-lqx97\" (UID: \"549832a5-fe7a-40f2-bf05-fa08e46f19d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:44.599899 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.599872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2fqz\" (UniqueName: \"kubernetes.io/projected/549832a5-fe7a-40f2-bf05-fa08e46f19d2-kube-api-access-c2fqz\") pod \"authorino-operator-75cc8d5cb7-lqx97\" (UID: \"549832a5-fe7a-40f2-bf05-fa08e46f19d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:44.739257 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.739167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:44.883218 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:44.883195    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"]
Jul 21 16:31:44.884724 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:44.884699    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549832a5_fe7a_40f2_bf05_fa08e46f19d2.slice/crio-e19f9bf92caab16bc2fcc29b015380527685e752a9e69357f8b5daf139bcfba3 WatchSource:0}: Error finding container e19f9bf92caab16bc2fcc29b015380527685e752a9e69357f8b5daf139bcfba3: Status 404 returned error can't find the container with id e19f9bf92caab16bc2fcc29b015380527685e752a9e69357f8b5daf139bcfba3
Jul 21 16:31:45.780489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:45.780451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97" event={"ID":"549832a5-fe7a-40f2-bf05-fa08e46f19d2","Type":"ContainerStarted","Data":"e19f9bf92caab16bc2fcc29b015380527685e752a9e69357f8b5daf139bcfba3"}
Jul 21 16:31:45.836873 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:45.836832    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:46.595440 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.595396    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:46.595637 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.595485    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:46.601948 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.601926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:46.792262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.792233    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db8fb776-wklfc"
Jul 21 16:31:46.868712 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.868680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:31:46.989442 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:46.989405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:47.098015 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:47.097990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:47.208237 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:47.207909    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:47.793201 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:47.793167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97" event={"ID":"549832a5-fe7a-40f2-bf05-fa08e46f19d2","Type":"ContainerStarted","Data":"3dc7721aea98b2f6f59a8a2a8fc768a53b6a0f78a59c8845169fc53810bd3bb7"}
Jul 21 16:31:47.793668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:47.793364    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:31:47.828580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:47.828533    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97" podStartSLOduration=1.68813737 podStartE2EDuration="3.828519525s" totalImagesPullingTime="2.140382155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:47.828394027 +0000 UTC m=+408.280949241" watchObservedRunningTime="2026-07-21 16:31:47.828519525 +0000 UTC m=+408.281074737"
Jul 21 16:31:48.500784 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:48.500742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:48.611025 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:48.610990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:48.821992 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:48.821908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:50.467842 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:50.467798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:51.844210 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:51.844166    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:51.967824 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:51.967789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:53.469180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:53.469145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:55.605488 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.605452    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"]
Jul 21 16:31:55.608524 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.608508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.611911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.611889    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qcfkb\""
Jul 21 16:31:55.666562 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.666535    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"]
Jul 21 16:31:55.675595 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.675571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.675693 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.675611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krhrj\" (UniqueName: \"kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.776995 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.776961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.777125 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.777009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krhrj\" (UniqueName: \"kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.777426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.777406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.788991 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.788968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krhrj\" (UniqueName: \"kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:55.917889 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:55.917845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:31:56.051857 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:56.051826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"]
Jul 21 16:31:56.056944 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:31:56.056909    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3813258f_8b61_4d8d_87c0_627e10e7049c.slice/crio-dbc61b55fae1a79bd33922d3e9e794a738c0e4205fec16ee47526a46fec164a6 WatchSource:0}: Error finding container dbc61b55fae1a79bd33922d3e9e794a738c0e4205fec16ee47526a46fec164a6: Status 404 returned error can't find the container with id dbc61b55fae1a79bd33922d3e9e794a738c0e4205fec16ee47526a46fec164a6
Jul 21 16:31:56.547493 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:56.547449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:56.649623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:56.649594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:56.835193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:56.835112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58" event={"ID":"3813258f-8b61-4d8d-87c0-627e10e7049c","Type":"ContainerStarted","Data":"dbc61b55fae1a79bd33922d3e9e794a738c0e4205fec16ee47526a46fec164a6"}
Jul 21 16:31:57.418834 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:57.418802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:57.519469 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:57.519426    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:31:58.800507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:31:58.800480    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lqx97"
Jul 21 16:32:00.815261 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:00.815221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:00.915142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:00.915099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:02.868722 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:02.868684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58" event={"ID":"3813258f-8b61-4d8d-87c0-627e10e7049c","Type":"ContainerStarted","Data":"3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1"}
Jul 21 16:32:02.869111 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:02.868784    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:02.906966 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:02.906911    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58" podStartSLOduration=1.957300979 podStartE2EDuration="7.906896758s" totalImagesPullingTime="5.949595779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:02.903239305 +0000 UTC m=+423.355794516" watchObservedRunningTime="2026-07-21 16:32:02.906896758 +0000 UTC m=+423.359451970"
Jul 21 16:32:04.824623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:04.824580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:04.939651 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:04.939611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:05.620349 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:05.620294    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:05.727935 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:05.727901    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:08.200793 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:08.200757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:08.302961 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:08.302924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:11.897152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:11.897110    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8579475db5-qmk6j" podUID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" containerName="console" containerID="cri-o://e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31" gracePeriod=15
Jul 21 16:32:12.132792 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.132767    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:32:12.216534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbvj9\" (UniqueName: \"kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216534 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216560    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216598    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216768    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config\") pod \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\" (UID: \"e9cb7e83-3f26-43a1-b340-b906a9bd8510\") "
Jul 21 16:32:12.216932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.216872    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:32:12.217097 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.217067    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.217097 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.217086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:32:12.217258 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.217127    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config" (OuterVolumeSpecName: "console-config") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:32:12.217330 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.217265    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:32:12.218792 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.218769    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:32:12.219146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.219127    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:32:12.219191 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.219140    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9" (OuterVolumeSpecName: "kube-api-access-gbvj9") pod "e9cb7e83-3f26-43a1-b340-b906a9bd8510" (UID: "e9cb7e83-3f26-43a1-b340-b906a9bd8510"). InnerVolumeSpecName "kube-api-access-gbvj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:12.317903 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317876    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-oauth-serving-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.317903 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317901    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-trusted-ca-bundle\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.317903 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317910    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-serving-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.318161 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317919    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-config\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.318161 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317927    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbvj9\" (UniqueName: \"kubernetes.io/projected/e9cb7e83-3f26-43a1-b340-b906a9bd8510-kube-api-access-gbvj9\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.318161 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.317934    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9cb7e83-3f26-43a1-b340-b906a9bd8510-console-oauth-config\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:12.917712 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.917678    2577 generic.go:356] "Generic (PLEG): container finished" podID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" containerID="e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31" exitCode=0
Jul 21 16:32:12.918180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.917728    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8579475db5-qmk6j"
Jul 21 16:32:12.918180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.917746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8579475db5-qmk6j" event={"ID":"e9cb7e83-3f26-43a1-b340-b906a9bd8510","Type":"ContainerDied","Data":"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"}
Jul 21 16:32:12.918180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.917784    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8579475db5-qmk6j" event={"ID":"e9cb7e83-3f26-43a1-b340-b906a9bd8510","Type":"ContainerDied","Data":"527c2a5955f57c9b0baf4ce9b065539f2854e474209477d387bee22a5302578b"}
Jul 21 16:32:12.918180 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.917803    2577 scope.go:117] "RemoveContainer" containerID="e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"
Jul 21 16:32:12.926722 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.926700    2577 scope.go:117] "RemoveContainer" containerID="e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"
Jul 21 16:32:12.926992 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:12.926971    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31\": container with ID starting with e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31 not found: ID does not exist" containerID="e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"
Jul 21 16:32:12.927053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.927004    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31"} err="failed to get container status \"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31\": rpc error: code = NotFound desc = could not find container \"e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31\": container with ID starting with e78fa0a0409dd9f16322415fb01061743693234795b15ca8beb709877e925a31 not found: ID does not exist"
Jul 21 16:32:12.940178 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.940139    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:32:12.945991 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:12.945970    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8579475db5-qmk6j"]
Jul 21 16:32:13.876069 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:13.876034    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:14.106750 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:14.106717    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" path="/var/lib/kubelet/pods/e9cb7e83-3f26-43a1-b340-b906a9bd8510/volumes"
Jul 21 16:32:15.673241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.673207    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"]
Jul 21 16:32:15.673744 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.673467    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" containerName="manager" containerID="cri-o://3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1" gracePeriod=2
Jul 21 16:32:15.683654 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.683629    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"]
Jul 21 16:32:15.688498 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:15.688458    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3813258f-8b61-4d8d-87c0-627e10e7049c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qsz58\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.705704 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.705678    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:15.706170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706135    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" containerName="console"
Jul 21 16:32:15.706170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706160    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" containerName="console"
Jul 21 16:32:15.706364 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706204    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" containerName="manager"
Jul 21 16:32:15.706364 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" containerName="manager"
Jul 21 16:32:15.706364 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706302    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" containerName="manager"
Jul 21 16:32:15.706364 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.706331    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cb7e83-3f26-43a1-b340-b906a9bd8510" containerName="console"
Jul 21 16:32:15.709250 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.709226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.731574 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.731552    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:15.752021 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:15.751990    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" is forbidden: User \"system:node:ip-10-0-141-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-38.ec2.internal' and this object" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.848923 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.848893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgp9r\" (UniqueName: \"kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.849041 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.848969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.917979 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.917959    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.920514 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:15.920491    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" is forbidden: User \"system:node:ip-10-0-141-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-38.ec2.internal' and this object" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.934232 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.934176    2577 generic.go:356] "Generic (PLEG): container finished" podID="3813258f-8b61-4d8d-87c0-627e10e7049c" containerID="3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1" exitCode=0
Jul 21 16:32:15.934232 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.934215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.934373 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.934280    2577 scope.go:117] "RemoveContainer" containerID="3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1"
Jul 21 16:32:15.936875 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:15.936855    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qsz58\" is forbidden: User \"system:node:ip-10-0-141-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-38.ec2.internal' and this object" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qsz58"
Jul 21 16:32:15.942442 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.942418    2577 scope.go:117] "RemoveContainer" containerID="3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1"
Jul 21 16:32:15.942686 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:15.942669    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1\": container with ID starting with 3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1 not found: ID does not exist" containerID="3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1"
Jul 21 16:32:15.942749 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.942699    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1"} err="failed to get container status \"3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1\": rpc error: code = NotFound desc = could not find container \"3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1\": container with ID starting with 3b5221511d9b7f416b88a3676f3f0579e30e29f03c1b55265141cd3b2f151ed1 not found: ID does not exist"
Jul 21 16:32:15.949503 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.949484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgp9r\" (UniqueName: \"kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.949592 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.949538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.949818 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.949802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:15.959395 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:15.959368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgp9r\" (UniqueName: \"kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-stmhb\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:16.050511 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.050477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume\") pod \"3813258f-8b61-4d8d-87c0-627e10e7049c\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") "
Jul 21 16:32:16.050667 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.050536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krhrj\" (UniqueName: \"kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj\") pod \"3813258f-8b61-4d8d-87c0-627e10e7049c\" (UID: \"3813258f-8b61-4d8d-87c0-627e10e7049c\") "
Jul 21 16:32:16.050954 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.050929    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3813258f-8b61-4d8d-87c0-627e10e7049c" (UID: "3813258f-8b61-4d8d-87c0-627e10e7049c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:16.052620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.052591    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj" (OuterVolumeSpecName: "kube-api-access-krhrj") pod "3813258f-8b61-4d8d-87c0-627e10e7049c" (UID: "3813258f-8b61-4d8d-87c0-627e10e7049c"). InnerVolumeSpecName "kube-api-access-krhrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:16.060766 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.060748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:16.109433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.109385    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3813258f-8b61-4d8d-87c0-627e10e7049c" path="/var/lib/kubelet/pods/3813258f-8b61-4d8d-87c0-627e10e7049c/volumes"
Jul 21 16:32:16.151948 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.151916    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krhrj\" (UniqueName: \"kubernetes.io/projected/3813258f-8b61-4d8d-87c0-627e10e7049c-kube-api-access-krhrj\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:16.151948 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.151951    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3813258f-8b61-4d8d-87c0-627e10e7049c-extensions-socket-volume\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:16.201514 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.201488    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:16.204050 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:32:16.204025    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65c421a_73b2_4772_8894_f895e3cab358.slice/crio-0974f04956bee3fe483aac995b6c6909f0d4b5fdf5e8c19d2e79e9c62a846770 WatchSource:0}: Error finding container 0974f04956bee3fe483aac995b6c6909f0d4b5fdf5e8c19d2e79e9c62a846770: Status 404 returned error can't find the container with id 0974f04956bee3fe483aac995b6c6909f0d4b5fdf5e8c19d2e79e9c62a846770
Jul 21 16:32:16.247434 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.247402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:16.343966 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.343935    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:16.886854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.886822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:16.940766 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.940732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" event={"ID":"c65c421a-73b2-4772-8894-f895e3cab358","Type":"ContainerStarted","Data":"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"}
Jul 21 16:32:16.940946 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.940787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" event={"ID":"c65c421a-73b2-4772-8894-f895e3cab358","Type":"ContainerStarted","Data":"0974f04956bee3fe483aac995b6c6909f0d4b5fdf5e8c19d2e79e9c62a846770"}
Jul 21 16:32:16.940946 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.940827    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:16.969004 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.968948    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" podStartSLOduration=1.96893161 podStartE2EDuration="1.96893161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:16.968176552 +0000 UTC m=+437.420731742" watchObservedRunningTime="2026-07-21 16:32:16.96893161 +0000 UTC m=+437.421486886"
Jul 21 16:32:16.978229 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:16.978200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:19.800843 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:19.800798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:19.855965 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:19.855932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:24.411412 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:24.411302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:24.518906 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:24.518867    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.832084 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:27.832047    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:27.948623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:27.948594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:27.961791 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:27.961760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:31.789783 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:31.789749    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:31.790178 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:31.789956    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" podUID="c65c421a-73b2-4772-8894-f895e3cab358" containerName="manager" containerID="cri-o://e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5" gracePeriod=10
Jul 21 16:32:32.251533 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.251508    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:32.385526 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.385497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume\") pod \"c65c421a-73b2-4772-8894-f895e3cab358\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") "
Jul 21 16:32:32.385679 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.385542    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgp9r\" (UniqueName: \"kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r\") pod \"c65c421a-73b2-4772-8894-f895e3cab358\" (UID: \"c65c421a-73b2-4772-8894-f895e3cab358\") "
Jul 21 16:32:32.385865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.385842    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c65c421a-73b2-4772-8894-f895e3cab358" (UID: "c65c421a-73b2-4772-8894-f895e3cab358"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:32.387527 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.387510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r" (OuterVolumeSpecName: "kube-api-access-pgp9r") pod "c65c421a-73b2-4772-8894-f895e3cab358" (UID: "c65c421a-73b2-4772-8894-f895e3cab358"). InnerVolumeSpecName "kube-api-access-pgp9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:32.486170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.486133    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgp9r\" (UniqueName: \"kubernetes.io/projected/c65c421a-73b2-4772-8894-f895e3cab358-kube-api-access-pgp9r\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:32.486170 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:32.486159    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c65c421a-73b2-4772-8894-f895e3cab358-extensions-socket-volume\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:32:33.017689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.017656    2577 generic.go:356] "Generic (PLEG): container finished" podID="c65c421a-73b2-4772-8894-f895e3cab358" containerID="e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5" exitCode=0
Jul 21 16:32:33.018088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.017698    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"
Jul 21 16:32:33.018088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.017715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" event={"ID":"c65c421a-73b2-4772-8894-f895e3cab358","Type":"ContainerDied","Data":"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"}
Jul 21 16:32:33.018088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.017758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb" event={"ID":"c65c421a-73b2-4772-8894-f895e3cab358","Type":"ContainerDied","Data":"0974f04956bee3fe483aac995b6c6909f0d4b5fdf5e8c19d2e79e9c62a846770"}
Jul 21 16:32:33.018088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.017779    2577 scope.go:117] "RemoveContainer" containerID="e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"
Jul 21 16:32:33.027001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.026983    2577 scope.go:117] "RemoveContainer" containerID="e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"
Jul 21 16:32:33.027266 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:32:33.027248    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5\": container with ID starting with e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5 not found: ID does not exist" containerID="e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"
Jul 21 16:32:33.027331 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.027275    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5"} err="failed to get container status \"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5\": rpc error: code = NotFound desc = could not find container \"e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5\": container with ID starting with e67eb4cf9057e9e70df53f7b035a2e90858565518ae9c2d8a78b7c385c59afe5 not found: ID does not exist"
Jul 21 16:32:33.043582 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.043556    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:33.056362 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:33.056341    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-stmhb"]
Jul 21 16:32:34.107178 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:34.107144    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65c421a-73b2-4772-8894-f895e3cab358" path="/var/lib/kubelet/pods/c65c421a-73b2-4772-8894-f895e3cab358/volumes"
Jul 21 16:32:48.078972 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.078937    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"]
Jul 21 16:32:48.079444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.079253    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65c421a-73b2-4772-8894-f895e3cab358" containerName="manager"
Jul 21 16:32:48.079444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.079264    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65c421a-73b2-4772-8894-f895e3cab358" containerName="manager"
Jul 21 16:32:48.079444 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.079337    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65c421a-73b2-4772-8894-f895e3cab358" containerName="manager"
Jul 21 16:32:48.082174 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.082149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.085076 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.085053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pj7q2\""
Jul 21 16:32:48.094828 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.094804    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"]
Jul 21 16:32:48.104188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408c8246-0a04-4319-a619-f9884e4e1f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104342 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408c8246-0a04-4319-a619-f9884e4e1f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qff9s\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-kube-api-access-qff9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.104600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.104502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.114787 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.114758    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.205761 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.205761 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408c8246-0a04-4319-a619-f9884e4e1f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qff9s\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-kube-api-access-qff9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408c8246-0a04-4319-a619-f9884e4e1f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.205993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206558 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.206955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.206932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408c8246-0a04-4319-a619-f9884e4e1f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.208301 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.208280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408c8246-0a04-4319-a619-f9884e4e1f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.208568 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.208548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408c8246-0a04-4319-a619-f9884e4e1f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.214106 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.214082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qff9s\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-kube-api-access-qff9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.214212 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.214181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408c8246-0a04-4319-a619-f9884e4e1f88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j78tl\" (UID: \"408c8246-0a04-4319-a619-f9884e4e1f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.214620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.214593    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:48.392772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.392739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:48.526602 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.526548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"]
Jul 21 16:32:48.528876 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:32:48.528846    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408c8246_0a04_4319_a619_f9884e4e1f88.slice/crio-4e7eb35e09efbb5e6e329c825633cbb39c6ca0b3846d8ff4798ab7270edd8937 WatchSource:0}: Error finding container 4e7eb35e09efbb5e6e329c825633cbb39c6ca0b3846d8ff4798ab7270edd8937: Status 404 returned error can't find the container with id 4e7eb35e09efbb5e6e329c825633cbb39c6ca0b3846d8ff4798ab7270edd8937
Jul 21 16:32:48.530884 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.530853    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:32:48.530965 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.530914    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:32:48.530965 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:48.530941    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:32:49.094864 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:49.094817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" event={"ID":"408c8246-0a04-4319-a619-f9884e4e1f88","Type":"ContainerStarted","Data":"1752e3589e3d0e2cdd2295c550f0e103f14a0c33c70caa71fe0ba84f938e9482"}
Jul 21 16:32:49.095229 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:49.094927    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" event={"ID":"408c8246-0a04-4319-a619-f9884e4e1f88","Type":"ContainerStarted","Data":"4e7eb35e09efbb5e6e329c825633cbb39c6ca0b3846d8ff4798ab7270edd8937"}
Jul 21 16:32:49.116651 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:49.116609    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" podStartSLOduration=1.1165952319999999 podStartE2EDuration="1.116595232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:49.115014121 +0000 UTC m=+469.567569334" watchObservedRunningTime="2026-07-21 16:32:49.116595232 +0000 UTC m=+469.569150443"
Jul 21 16:32:49.393883 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:49.393846    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:49.398472 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:49.398448    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:50.100802 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:50.100769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:50.107781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:50.107755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:32:51.311463 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.311433    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:51.621147 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.621111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:51.621963 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.621946    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:32:51.624435 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.624417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.627968 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.627949    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 16:32:51.628084 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.628024    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tztzv\""
Jul 21 16:32:51.639666 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.639637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:32:51.725969 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.725927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:32:51.733091 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.733055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.733240 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.733141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggb9g\" (UniqueName: \"kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.733980 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.733937    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:51.815026 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.814986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:51.834230 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.834195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.834436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.834259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggb9g\" (UniqueName: \"kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.834888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.834862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.843973 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.843946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggb9g\" (UniqueName: \"kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g\") pod \"limitador-limitador-64c94fd64f-w66ns\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:51.934720 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:51.934631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:52.078660 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.078629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:32:52.080407 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:32:52.080370    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb153bd4_2d1f_44d0_9340_711c79f6162c.slice/crio-c1090cd2aeb267e5b0bd04e683bf72ad93a6047ed2936853ef481d2214eb7bc9 WatchSource:0}: Error finding container c1090cd2aeb267e5b0bd04e683bf72ad93a6047ed2936853ef481d2214eb7bc9: Status 404 returned error can't find the container with id c1090cd2aeb267e5b0bd04e683bf72ad93a6047ed2936853ef481d2214eb7bc9
Jul 21 16:32:52.110087 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.110047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" event={"ID":"fb153bd4-2d1f-44d0-9340-711c79f6162c","Type":"ContainerStarted","Data":"c1090cd2aeb267e5b0bd04e683bf72ad93a6047ed2936853ef481d2214eb7bc9"}
Jul 21 16:32:52.437866 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.437838    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:32:52.440661 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.440640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:32:52.443436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.443416    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mw5sk\""
Jul 21 16:32:52.449841 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.449822    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:32:52.470200 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.470169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:52.534354 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.534303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:32:52.539329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.539285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbbrq\" (UniqueName: \"kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq\") pod \"authorino-58cd955675-t8cvs\" (UID: \"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8\") " pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:32:52.632855 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.632823    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:32:52.635425 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.635401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:32:52.639888 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.639862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbrq\" (UniqueName: \"kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq\") pod \"authorino-58cd955675-t8cvs\" (UID: \"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8\") " pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:32:52.644088 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.644067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:32:52.653553 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.653529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbbrq\" (UniqueName: \"kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq\") pod \"authorino-58cd955675-t8cvs\" (UID: \"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8\") " pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:32:52.740567 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.740479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4glv\" (UniqueName: \"kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv\") pod \"authorino-75d556bd77-fmgsh\" (UID: \"d5f8b51f-cb74-426a-ba4a-bef17883f20b\") " pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:32:52.752409 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.752372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:32:52.842264 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.841794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4glv\" (UniqueName: \"kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv\") pod \"authorino-75d556bd77-fmgsh\" (UID: \"d5f8b51f-cb74-426a-ba4a-bef17883f20b\") " pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:32:52.855653 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.855624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4glv\" (UniqueName: \"kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv\") pod \"authorino-75d556bd77-fmgsh\" (UID: \"d5f8b51f-cb74-426a-ba4a-bef17883f20b\") " pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:32:52.927639 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.927472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:32:52.932379 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:32:52.932342    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4f9c2d1_b5e3_45aa_a1c5_5487ffc163a8.slice/crio-59e0ae6636b4f17e9c048aa24df65ace42e732c471568d20914c0d6d14c54b42 WatchSource:0}: Error finding container 59e0ae6636b4f17e9c048aa24df65ace42e732c471568d20914c0d6d14c54b42: Status 404 returned error can't find the container with id 59e0ae6636b4f17e9c048aa24df65ace42e732c471568d20914c0d6d14c54b42
Jul 21 16:32:52.945782 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:52.945578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:32:53.119671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:53.119610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t8cvs" event={"ID":"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8","Type":"ContainerStarted","Data":"59e0ae6636b4f17e9c048aa24df65ace42e732c471568d20914c0d6d14c54b42"}
Jul 21 16:32:53.120193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:53.120141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:32:53.121743 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:32:53.121712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5f8b51f_cb74_426a_ba4a_bef17883f20b.slice/crio-332306e65bc875b0d7f45f8d9701e5ceca75f5207971e9f9e460ff3d63f59404 WatchSource:0}: Error finding container 332306e65bc875b0d7f45f8d9701e5ceca75f5207971e9f9e460ff3d63f59404: Status 404 returned error can't find the container with id 332306e65bc875b0d7f45f8d9701e5ceca75f5207971e9f9e460ff3d63f59404
Jul 21 16:32:54.126301 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:54.126263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fmgsh" event={"ID":"d5f8b51f-cb74-426a-ba4a-bef17883f20b","Type":"ContainerStarted","Data":"332306e65bc875b0d7f45f8d9701e5ceca75f5207971e9f9e460ff3d63f59404"}
Jul 21 16:32:55.132918 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:55.132880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" event={"ID":"fb153bd4-2d1f-44d0-9340-711c79f6162c","Type":"ContainerStarted","Data":"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"}
Jul 21 16:32:55.133354 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:55.132996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:32:55.158995 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:55.158922    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" podStartSLOduration=1.515828376 podStartE2EDuration="4.158899508s" totalImagesPullingTime="2.643071132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:55.156766541 +0000 UTC m=+475.609321754" watchObservedRunningTime="2026-07-21 16:32:55.158899508 +0000 UTC m=+475.611454748"
Jul 21 16:32:58.152107 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:58.152073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t8cvs" event={"ID":"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8","Type":"ContainerStarted","Data":"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"}
Jul 21 16:32:58.153492 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:58.153462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fmgsh" event={"ID":"d5f8b51f-cb74-426a-ba4a-bef17883f20b","Type":"ContainerStarted","Data":"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"}
Jul 21 16:32:58.167732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:58.167689    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t8cvs" podStartSLOduration=1.992353902 podStartE2EDuration="6.16767496s" totalImagesPullingTime="4.175321058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:58.166536916 +0000 UTC m=+478.619092128" watchObservedRunningTime="2026-07-21 16:32:58.16767496 +0000 UTC m=+478.620230172"
Jul 21 16:32:58.182517 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:58.182473    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fmgsh" podStartSLOduration=2.192209742 podStartE2EDuration="6.182459024s" totalImagesPullingTime="3.990249282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:58.180766441 +0000 UTC m=+478.633321654" watchObservedRunningTime="2026-07-21 16:32:58.182459024 +0000 UTC m=+478.635014287"
Jul 21 16:32:58.206353 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:32:58.206304    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:33:00.163164 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:00.163123    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t8cvs" podUID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" containerName="authorino" containerID="cri-o://2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e" gracePeriod=30
Jul 21 16:33:00.400083 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:00.400062    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:33:00.512369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:00.512262    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbbrq\" (UniqueName: \"kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq\") pod \"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8\" (UID: \"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8\") "
Jul 21 16:33:00.514292 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:00.514261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq" (OuterVolumeSpecName: "kube-api-access-rbbrq") pod "b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" (UID: "b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8"). InnerVolumeSpecName "kube-api-access-rbbrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:00.613381 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:00.613341    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbbrq\" (UniqueName: \"kubernetes.io/projected/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8-kube-api-access-rbbrq\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:01.168927 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.168889    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" containerID="2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e" exitCode=0
Jul 21 16:33:01.169393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.168946    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t8cvs"
Jul 21 16:33:01.169393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.168970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t8cvs" event={"ID":"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8","Type":"ContainerDied","Data":"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"}
Jul 21 16:33:01.169393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.169013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t8cvs" event={"ID":"b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8","Type":"ContainerDied","Data":"59e0ae6636b4f17e9c048aa24df65ace42e732c471568d20914c0d6d14c54b42"}
Jul 21 16:33:01.169393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.169032    2577 scope.go:117] "RemoveContainer" containerID="2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"
Jul 21 16:33:01.177555 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.177539    2577 scope.go:117] "RemoveContainer" containerID="2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"
Jul 21 16:33:01.177808 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:01.177791    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e\": container with ID starting with 2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e not found: ID does not exist" containerID="2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"
Jul 21 16:33:01.177856 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.177817    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e"} err="failed to get container status \"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e\": rpc error: code = NotFound desc = could not find container \"2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e\": container with ID starting with 2151fcfae73a1d263d7ac45005192e97f99584e0b69b61bbf9c5b4acd280898e not found: ID does not exist"
Jul 21 16:33:01.190166 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.190143    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:33:01.193916 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:01.193895    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t8cvs"]
Jul 21 16:33:02.108247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:02.108218    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" path="/var/lib/kubelet/pods/b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8/volumes"
Jul 21 16:33:06.138502 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:06.138471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:33:08.196152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.196114    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:33:08.196654 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.196328    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" podUID="fb153bd4-2d1f-44d0-9340-711c79f6162c" containerName="limitador" containerID="cri-o://0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c" gracePeriod=30
Jul 21 16:33:08.742096 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.742074    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:33:08.888821 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.888786    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file\") pod \"fb153bd4-2d1f-44d0-9340-711c79f6162c\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") "
Jul 21 16:33:08.888974 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.888855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggb9g\" (UniqueName: \"kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g\") pod \"fb153bd4-2d1f-44d0-9340-711c79f6162c\" (UID: \"fb153bd4-2d1f-44d0-9340-711c79f6162c\") "
Jul 21 16:33:08.889228 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.889206    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file" (OuterVolumeSpecName: "config-file") pod "fb153bd4-2d1f-44d0-9340-711c79f6162c" (UID: "fb153bd4-2d1f-44d0-9340-711c79f6162c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:33:08.890826 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.890803    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g" (OuterVolumeSpecName: "kube-api-access-ggb9g") pod "fb153bd4-2d1f-44d0-9340-711c79f6162c" (UID: "fb153bd4-2d1f-44d0-9340-711c79f6162c"). InnerVolumeSpecName "kube-api-access-ggb9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:08.990393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.990352    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggb9g\" (UniqueName: \"kubernetes.io/projected/fb153bd4-2d1f-44d0-9340-711c79f6162c-kube-api-access-ggb9g\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:08.990393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:08.990386    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fb153bd4-2d1f-44d0-9340-711c79f6162c-config-file\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:09.206582 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.206481    2577 generic.go:356] "Generic (PLEG): container finished" podID="fb153bd4-2d1f-44d0-9340-711c79f6162c" containerID="0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c" exitCode=0
Jul 21 16:33:09.206582 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.206532    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns"
Jul 21 16:33:09.206582 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.206567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" event={"ID":"fb153bd4-2d1f-44d0-9340-711c79f6162c","Type":"ContainerDied","Data":"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"}
Jul 21 16:33:09.207108 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.206624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w66ns" event={"ID":"fb153bd4-2d1f-44d0-9340-711c79f6162c","Type":"ContainerDied","Data":"c1090cd2aeb267e5b0bd04e683bf72ad93a6047ed2936853ef481d2214eb7bc9"}
Jul 21 16:33:09.207108 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.206653    2577 scope.go:117] "RemoveContainer" containerID="0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"
Jul 21 16:33:09.215305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.215285    2577 scope.go:117] "RemoveContainer" containerID="0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"
Jul 21 16:33:09.215552 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:09.215532    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c\": container with ID starting with 0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c not found: ID does not exist" containerID="0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"
Jul 21 16:33:09.215601 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.215561    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c"} err="failed to get container status \"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c\": rpc error: code = NotFound desc = could not find container \"0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c\": container with ID starting with 0ca46e8b9b26fb886d19e7772b176ea3eb1b7c3f594f2b88f6b4cab4684c722c not found: ID does not exist"
Jul 21 16:33:09.229938 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.229911    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:33:09.235527 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:09.235509    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w66ns"]
Jul 21 16:33:10.106991 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:10.106959    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb153bd4-2d1f-44d0-9340-711c79f6162c" path="/var/lib/kubelet/pods/fb153bd4-2d1f-44d0-9340-711c79f6162c/volumes"
Jul 21 16:33:11.319632 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.319599    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.420692 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.420659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.780255 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780224    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"]
Jul 21 16:33:11.780708 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780691    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" containerName="authorino"
Jul 21 16:33:11.780754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780711    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" containerName="authorino"
Jul 21 16:33:11.780754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780729    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb153bd4-2d1f-44d0-9340-711c79f6162c" containerName="limitador"
Jul 21 16:33:11.780754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780738    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb153bd4-2d1f-44d0-9340-711c79f6162c" containerName="limitador"
Jul 21 16:33:11.780845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780829    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb153bd4-2d1f-44d0-9340-711c79f6162c" containerName="limitador"
Jul 21 16:33:11.780878 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.780844    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f9c2d1-b5e3-45aa-a1c5-5487ffc163a8" containerName="authorino"
Jul 21 16:33:11.783667 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.783648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:11.786684 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.786663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nfbhl\""
Jul 21 16:33:11.786794 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.786671    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 16:33:11.787968 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.787951    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:33:11.788085 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.787951    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 16:33:11.792707 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.792678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"]
Jul 21 16:33:11.818958 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.818931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:11.912136 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.912107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgl7\" (UniqueName: \"kubernetes.io/projected/053322ce-aa7d-4452-b5f2-f84f49f66867-kube-api-access-wvgl7\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:11.912287 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:11.912155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/053322ce-aa7d-4452-b5f2-f84f49f66867-data\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.012700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.012667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgl7\" (UniqueName: \"kubernetes.io/projected/053322ce-aa7d-4452-b5f2-f84f49f66867-kube-api-access-wvgl7\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.012700 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.012705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/053322ce-aa7d-4452-b5f2-f84f49f66867-data\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.013059 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.013045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/053322ce-aa7d-4452-b5f2-f84f49f66867-data\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.022662 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.022636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgl7\" (UniqueName: \"kubernetes.io/projected/053322ce-aa7d-4452-b5f2-f84f49f66867-kube-api-access-wvgl7\") pod \"postgres-69fb4594cf-mfzhb\" (UID: \"053322ce-aa7d-4452-b5f2-f84f49f66867\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.094771 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.094697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:12.224154 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:12.224108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"]
Jul 21 16:33:12.228286 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:33:12.228259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053322ce_aa7d_4452_b5f2_f84f49f66867.slice/crio-9b41ae7015fb24240988a15353f8dbf445f17277b691213e53a6e4262458ecc2 WatchSource:0}: Error finding container 9b41ae7015fb24240988a15353f8dbf445f17277b691213e53a6e4262458ecc2: Status 404 returned error can't find the container with id 9b41ae7015fb24240988a15353f8dbf445f17277b691213e53a6e4262458ecc2
Jul 21 16:33:13.232613 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:13.232578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb" event={"ID":"053322ce-aa7d-4452-b5f2-f84f49f66867","Type":"ContainerStarted","Data":"9b41ae7015fb24240988a15353f8dbf445f17277b691213e53a6e4262458ecc2"}
Jul 21 16:33:19.268512 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:19.268472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb" event={"ID":"053322ce-aa7d-4452-b5f2-f84f49f66867","Type":"ContainerStarted","Data":"e8e806989054c5a5833f33f538d02f73c87175eb39a355da4365bb5595b33d97"}
Jul 21 16:33:19.268913 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:19.268602    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:19.284698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:19.284639    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb" podStartSLOduration=2.287515571 podStartE2EDuration="8.284620514s" totalImagesPullingTime="5.997104943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:19.284008354 +0000 UTC m=+499.736563568" watchObservedRunningTime="2026-07-21 16:33:19.284620514 +0000 UTC m=+499.737175726"
Jul 21 16:33:25.308213 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.308183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mfzhb"
Jul 21 16:33:25.612500 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.612468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:25.712886 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.712851    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:25.842746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.842711    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msfhq"]
Jul 21 16:33:25.845024 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.845008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:25.853817 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.853796    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msfhq"]
Jul 21 16:33:25.932208 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:25.932135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-542sr\" (UniqueName: \"kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr\") pod \"authorino-5d4b67c446-msfhq\" (UID: \"eb108db0-079d-4d00-a279-49549803b068\") " pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:26.032588 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.032557    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msfhq"]
Jul 21 16:33:26.032713 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.032672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542sr\" (UniqueName: \"kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr\") pod \"authorino-5d4b67c446-msfhq\" (UID: \"eb108db0-079d-4d00-a279-49549803b068\") " pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:26.032761 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:26.032748    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-542sr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-msfhq" podUID="eb108db0-079d-4d00-a279-49549803b068"
Jul 21 16:33:26.046126 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.046098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-542sr\" (UniqueName: \"kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr\") pod \"authorino-5d4b67c446-msfhq\" (UID: \"eb108db0-079d-4d00-a279-49549803b068\") " pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:26.065672 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.065647    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-2sddp"]
Jul 21 16:33:26.067846 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.067831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.070604 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.070588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 16:33:26.077457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.077437    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-2sddp"]
Jul 21 16:33:26.119241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.119213    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2sddp"]
Jul 21 16:33:26.119458 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:26.119438    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-p8nqd tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-p8nqd tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-2sddp" podUID="c65697fb-f357-47a1-af8f-d60c119a14d6"
Jul 21 16:33:26.155173 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.155143    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:33:26.157256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.157237    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.169472 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.169448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:33:26.234363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.234290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nqd\" (UniqueName: \"kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.234363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.234352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.307058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.307030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.307058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.307055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:26.312645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.312621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.315655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.315637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:26.335442 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.335413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm4wl\" (UniqueName: \"kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.335536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.335448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.335536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.335498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nqd\" (UniqueName: \"kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.335536 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.335532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.337803 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.337784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.343802 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.343781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nqd\" (UniqueName: \"kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd\") pod \"authorino-76877994-2sddp\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") " pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:26.436202 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.436168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert\") pod \"c65697fb-f357-47a1-af8f-d60c119a14d6\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") "
Jul 21 16:33:26.436411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.436251    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-542sr\" (UniqueName: \"kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr\") pod \"eb108db0-079d-4d00-a279-49549803b068\" (UID: \"eb108db0-079d-4d00-a279-49549803b068\") "
Jul 21 16:33:26.436411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.436277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8nqd\" (UniqueName: \"kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd\") pod \"c65697fb-f357-47a1-af8f-d60c119a14d6\" (UID: \"c65697fb-f357-47a1-af8f-d60c119a14d6\") "
Jul 21 16:33:26.436514 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.436411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm4wl\" (UniqueName: \"kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.436514 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.436454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.438426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.438395    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c65697fb-f357-47a1-af8f-d60c119a14d6" (UID: "c65697fb-f357-47a1-af8f-d60c119a14d6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:33:26.438579 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.438555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr" (OuterVolumeSpecName: "kube-api-access-542sr") pod "eb108db0-079d-4d00-a279-49549803b068" (UID: "eb108db0-079d-4d00-a279-49549803b068"). InnerVolumeSpecName "kube-api-access-542sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:26.438769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.438751    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd" (OuterVolumeSpecName: "kube-api-access-p8nqd") pod "c65697fb-f357-47a1-af8f-d60c119a14d6" (UID: "c65697fb-f357-47a1-af8f-d60c119a14d6"). InnerVolumeSpecName "kube-api-access-p8nqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:26.439135 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.439118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.445880 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.445857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm4wl\" (UniqueName: \"kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl\") pod \"authorino-588cf5fd6b-69dg4\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") " pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.465797 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.465779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:33:26.537821 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.537796    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-542sr\" (UniqueName: \"kubernetes.io/projected/eb108db0-079d-4d00-a279-49549803b068-kube-api-access-542sr\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:26.537821 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.537821    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8nqd\" (UniqueName: \"kubernetes.io/projected/c65697fb-f357-47a1-af8f-d60c119a14d6-kube-api-access-p8nqd\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:26.537992 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.537832    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65697fb-f357-47a1-af8f-d60c119a14d6-tls-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:26.590076 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:26.590052    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:33:26.591790 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:33:26.591764    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76ee3a7a_fbd1_480e_a9c3_3615f7ee6168.slice/crio-fc8c562472a9d6be605a62f0a5a37c39a053d335667174d2872bd335ab82dd4b WatchSource:0}: Error finding container fc8c562472a9d6be605a62f0a5a37c39a053d335667174d2872bd335ab82dd4b: Status 404 returned error can't find the container with id fc8c562472a9d6be605a62f0a5a37c39a053d335667174d2872bd335ab82dd4b
Jul 21 16:33:27.313740 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.313634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" event={"ID":"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168","Type":"ContainerStarted","Data":"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"}
Jul 21 16:33:27.313740 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.313696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" event={"ID":"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168","Type":"ContainerStarted","Data":"fc8c562472a9d6be605a62f0a5a37c39a053d335667174d2872bd335ab82dd4b"}
Jul 21 16:33:27.313740 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.313659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msfhq"
Jul 21 16:33:27.313740 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.313653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-2sddp"
Jul 21 16:33:27.347448 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.347392    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" podStartSLOduration=0.983986796 podStartE2EDuration="1.347372082s" totalImagesPullingTime="363.385286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:27.329674165 +0000 UTC m=+507.782229379" watchObservedRunningTime="2026-07-21 16:33:27.347372082 +0000 UTC m=+507.799927295"
Jul 21 16:33:27.354564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.354536    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-2sddp"]
Jul 21 16:33:27.362614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.362579    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:33:27.362818 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.362790    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fmgsh" podUID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" containerName="authorino" containerID="cri-o://1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154" gracePeriod=30
Jul 21 16:33:27.364913 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.364890    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-2sddp"]
Jul 21 16:33:27.390280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.390248    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msfhq"]
Jul 21 16:33:27.394231 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.394199    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msfhq"]
Jul 21 16:33:27.603929 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.603907    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:33:27.747791 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.747752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4glv\" (UniqueName: \"kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv\") pod \"d5f8b51f-cb74-426a-ba4a-bef17883f20b\" (UID: \"d5f8b51f-cb74-426a-ba4a-bef17883f20b\") "
Jul 21 16:33:27.749731 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.749700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv" (OuterVolumeSpecName: "kube-api-access-n4glv") pod "d5f8b51f-cb74-426a-ba4a-bef17883f20b" (UID: "d5f8b51f-cb74-426a-ba4a-bef17883f20b"). InnerVolumeSpecName "kube-api-access-n4glv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:27.848530 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:27.848458    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4glv\" (UniqueName: \"kubernetes.io/projected/d5f8b51f-cb74-426a-ba4a-bef17883f20b-kube-api-access-n4glv\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.108037 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.108007    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65697fb-f357-47a1-af8f-d60c119a14d6" path="/var/lib/kubelet/pods/c65697fb-f357-47a1-af8f-d60c119a14d6/volumes"
Jul 21 16:33:28.108250 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.108237    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb108db0-079d-4d00-a279-49549803b068" path="/var/lib/kubelet/pods/eb108db0-079d-4d00-a279-49549803b068/volumes"
Jul 21 16:33:28.319253 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.319215    2577 generic.go:356] "Generic (PLEG): container finished" podID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" containerID="1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154" exitCode=0
Jul 21 16:33:28.319675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.319270    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fmgsh"
Jul 21 16:33:28.319675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.319292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fmgsh" event={"ID":"d5f8b51f-cb74-426a-ba4a-bef17883f20b","Type":"ContainerDied","Data":"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"}
Jul 21 16:33:28.319675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.319349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fmgsh" event={"ID":"d5f8b51f-cb74-426a-ba4a-bef17883f20b","Type":"ContainerDied","Data":"332306e65bc875b0d7f45f8d9701e5ceca75f5207971e9f9e460ff3d63f59404"}
Jul 21 16:33:28.319675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.319367    2577 scope.go:117] "RemoveContainer" containerID="1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"
Jul 21 16:33:28.327644 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.327628    2577 scope.go:117] "RemoveContainer" containerID="1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"
Jul 21 16:33:28.327880 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:28.327862    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154\": container with ID starting with 1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154 not found: ID does not exist" containerID="1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"
Jul 21 16:33:28.327924 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.327890    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154"} err="failed to get container status \"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154\": rpc error: code = NotFound desc = could not find container \"1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154\": container with ID starting with 1876a0e481a9ecc99cf45406ea1236736234e8921c9a4befdea1f6d41285a154 not found: ID does not exist"
Jul 21 16:33:28.336769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.336747    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:33:28.340640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:28.340620    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fmgsh"]
Jul 21 16:33:30.108681 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:30.108651    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" path="/var/lib/kubelet/pods/d5f8b51f-cb74-426a-ba4a-bef17883f20b/volumes"
Jul 21 16:33:31.997148 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:31.997112    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:32.021206 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.021171    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:32.021564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.021540    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" containerName="authorino"
Jul 21 16:33:32.021564 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.021558    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" containerName="authorino"
Jul 21 16:33:32.021726 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.021624    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f8b51f-cb74-426a-ba4a-bef17883f20b" containerName="authorino"
Jul 21 16:33:32.024887 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.024869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.027910 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.027890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:33:32.028025 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.028009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xl2w6\""
Jul 21 16:33:32.029196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.029179    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:33:32.035146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.035127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:32.097139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.097078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:32.154036 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.153998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:32.183084 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.183051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.183245 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.183163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cwp\" (UniqueName: \"kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.191332 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.191289    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:33:32.193554 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.193539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.204012 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.203989    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:33:32.284101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.284019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.284101 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.284090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cwp\" (UniqueName: \"kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.284369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.284109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44xn\" (UniqueName: \"kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.284369 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.284135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.286510 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.286492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.294976 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.294947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cwp\" (UniqueName: \"kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp\") pod \"maas-controller-55658556f6-fqptl\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") " pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.310267 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.310238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:32.336158 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.336124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:32.385382 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.385351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44xn\" (UniqueName: \"kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.385580 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.385436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.387846 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.387824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.395333 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.395283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44xn\" (UniqueName: \"kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn\") pod \"maas-controller-5486b4fd5-gxxc6\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") " pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.465365 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.465342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:32.466284 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:33:32.466258    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cce9633_6382_4e3d_9292_52e436808274.slice/crio-c56e401fb07cf2285b210af364a34332fe9a50da36a115ffaf3b9ae5d6b35d44 WatchSource:0}: Error finding container c56e401fb07cf2285b210af364a34332fe9a50da36a115ffaf3b9ae5d6b35d44: Status 404 returned error can't find the container with id c56e401fb07cf2285b210af364a34332fe9a50da36a115ffaf3b9ae5d6b35d44
Jul 21 16:33:32.503727 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.503706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:32.633093 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:32.633063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:33:32.633954 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:33:32.633930    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f6bd74_940b_4fb0_9658_5e09d7a1fa1d.slice/crio-a4565a5086a394e0133138852f6a009f25ebe23f45374ec43e3f4f3dee0d110b WatchSource:0}: Error finding container a4565a5086a394e0133138852f6a009f25ebe23f45374ec43e3f4f3dee0d110b: Status 404 returned error can't find the container with id a4565a5086a394e0133138852f6a009f25ebe23f45374ec43e3f4f3dee0d110b
Jul 21 16:33:33.346919 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:33.346842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" event={"ID":"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d","Type":"ContainerStarted","Data":"a4565a5086a394e0133138852f6a009f25ebe23f45374ec43e3f4f3dee0d110b"}
Jul 21 16:33:33.348590 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:33.348559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55658556f6-fqptl" event={"ID":"6cce9633-6382-4e3d-9292-52e436808274","Type":"ContainerStarted","Data":"c56e401fb07cf2285b210af364a34332fe9a50da36a115ffaf3b9ae5d6b35d44"}
Jul 21 16:33:34.804919 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:34.804884    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:34.902905 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:34.902832    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:35.359912 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.359883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" event={"ID":"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d","Type":"ContainerStarted","Data":"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"}
Jul 21 16:33:35.360075 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.359971    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:35.361455 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.361427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55658556f6-fqptl" event={"ID":"6cce9633-6382-4e3d-9292-52e436808274","Type":"ContainerStarted","Data":"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"}
Jul 21 16:33:35.361584 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.361570    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:35.389834 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.389780    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" podStartSLOduration=1.382502836 podStartE2EDuration="3.389764449s" totalImagesPullingTime="2.007261613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:35.387521917 +0000 UTC m=+515.840077128" watchObservedRunningTime="2026-07-21 16:33:35.389764449 +0000 UTC m=+515.842319660"
Jul 21 16:33:35.409809 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:35.409736    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55658556f6-fqptl" podStartSLOduration=1.235212707 podStartE2EDuration="3.409721171s" totalImagesPullingTime="2.174508464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:35.407865839 +0000 UTC m=+515.860421062" watchObservedRunningTime="2026-07-21 16:33:35.409721171 +0000 UTC m=+515.862276384"
Jul 21 16:33:44.098067 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:44.098025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:44.163443 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:44.163409    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:33:46.369276 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.369245    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:33:46.369668 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.369341    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:46.433356 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.433301    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:46.433540 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.433521    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55658556f6-fqptl" podUID="6cce9633-6382-4e3d-9292-52e436808274" containerName="manager" containerID="cri-o://fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e" gracePeriod=30
Jul 21 16:33:46.672521 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.672500    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:46.697727 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.697697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4cwp\" (UniqueName: \"kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp\") pod \"6cce9633-6382-4e3d-9292-52e436808274\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") "
Jul 21 16:33:46.697869 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.697810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert\") pod \"6cce9633-6382-4e3d-9292-52e436808274\" (UID: \"6cce9633-6382-4e3d-9292-52e436808274\") "
Jul 21 16:33:46.699901 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.699867    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp" (OuterVolumeSpecName: "kube-api-access-j4cwp") pod "6cce9633-6382-4e3d-9292-52e436808274" (UID: "6cce9633-6382-4e3d-9292-52e436808274"). InnerVolumeSpecName "kube-api-access-j4cwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:46.700018 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.699897    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6cce9633-6382-4e3d-9292-52e436808274" (UID: "6cce9633-6382-4e3d-9292-52e436808274"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:33:46.799324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.799274    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cce9633-6382-4e3d-9292-52e436808274-webhook-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:46.799324 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:46.799303    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4cwp\" (UniqueName: \"kubernetes.io/projected/6cce9633-6382-4e3d-9292-52e436808274-kube-api-access-j4cwp\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:33:47.420270 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.420232    2577 generic.go:356] "Generic (PLEG): container finished" podID="6cce9633-6382-4e3d-9292-52e436808274" containerID="fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e" exitCode=0
Jul 21 16:33:47.420689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.420288    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55658556f6-fqptl"
Jul 21 16:33:47.420689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.420335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55658556f6-fqptl" event={"ID":"6cce9633-6382-4e3d-9292-52e436808274","Type":"ContainerDied","Data":"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"}
Jul 21 16:33:47.420689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.420394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55658556f6-fqptl" event={"ID":"6cce9633-6382-4e3d-9292-52e436808274","Type":"ContainerDied","Data":"c56e401fb07cf2285b210af364a34332fe9a50da36a115ffaf3b9ae5d6b35d44"}
Jul 21 16:33:47.420689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.420423    2577 scope.go:117] "RemoveContainer" containerID="fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"
Jul 21 16:33:47.429249 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.429235    2577 scope.go:117] "RemoveContainer" containerID="fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"
Jul 21 16:33:47.429518 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:33:47.429495    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e\": container with ID starting with fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e not found: ID does not exist" containerID="fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"
Jul 21 16:33:47.429578 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.429526    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e"} err="failed to get container status \"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e\": rpc error: code = NotFound desc = could not find container \"fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e\": container with ID starting with fc01376ae7b660b293f8b53591a08745f3e123a3522f397245898fdaa37ed78e not found: ID does not exist"
Jul 21 16:33:47.442356 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.442332    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:47.446732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:47.446710    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55658556f6-fqptl"]
Jul 21 16:33:48.107091 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:48.107055    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cce9633-6382-4e3d-9292-52e436808274" path="/var/lib/kubelet/pods/6cce9633-6382-4e3d-9292-52e436808274/volumes"
Jul 21 16:33:51.215359 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:33:51.215331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:07.062044 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.062004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:07.159072 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.159026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:07.794198 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.794157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"]
Jul 21 16:34:07.794526 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.794511    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cce9633-6382-4e3d-9292-52e436808274" containerName="manager"
Jul 21 16:34:07.794526 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.794528    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cce9633-6382-4e3d-9292-52e436808274" containerName="manager"
Jul 21 16:34:07.794659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.794594    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cce9633-6382-4e3d-9292-52e436808274" containerName="manager"
Jul 21 16:34:07.801216 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.801196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.804145 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.804124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 16:34:07.804262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.804207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-q9vn8\""
Jul 21 16:34:07.811165 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.811147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"]
Jul 21 16:34:07.873123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.873096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-maas-api-tls\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.873123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.873127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-openshift-service-ca\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.873379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.873206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4f7j\" (UniqueName: \"kubernetes.io/projected/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-kube-api-access-j4f7j\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.974257 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.974224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-maas-api-tls\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.974472 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.974272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-openshift-service-ca\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.974472 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.974392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4f7j\" (UniqueName: \"kubernetes.io/projected/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-kube-api-access-j4f7j\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.975193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.975163    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-openshift-service-ca\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.977238 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.977211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-maas-api-tls\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:07.983290 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:07.983268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4f7j\" (UniqueName: \"kubernetes.io/projected/0f0f2dad-8724-4f43-bb95-fd1ae0e808a3-kube-api-access-j4f7j\") pod \"maas-api-7b9ff9cd55-tct8n\" (UID: \"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3\") " pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:08.112402 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.112376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:08.250576 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.250548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"]
Jul 21 16:34:08.251565 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:34:08.251512    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0f2dad_8724_4f43_bb95_fd1ae0e808a3.slice/crio-15639b2de8ec02535a70a8c6743c5007e248880bda606d75b25decceb1f96edc WatchSource:0}: Error finding container 15639b2de8ec02535a70a8c6743c5007e248880bda606d75b25decceb1f96edc: Status 404 returned error can't find the container with id 15639b2de8ec02535a70a8c6743c5007e248880bda606d75b25decceb1f96edc
Jul 21 16:34:08.352096 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.352062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vls22"]
Jul 21 16:34:08.355225 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.355206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.360939 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.360919    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 16:34:08.375849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.375787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vls22"]
Jul 21 16:34:08.480058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.480021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/697a4d54-3dc7-4529-9513-ab92f02ce46b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.480241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.480067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j825h\" (UniqueName: \"kubernetes.io/projected/697a4d54-3dc7-4529-9513-ab92f02ce46b-kube-api-access-j825h\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.526737 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.526701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n" event={"ID":"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3","Type":"ContainerStarted","Data":"15639b2de8ec02535a70a8c6743c5007e248880bda606d75b25decceb1f96edc"}
Jul 21 16:34:08.581427 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.581393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/697a4d54-3dc7-4529-9513-ab92f02ce46b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.581608 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.581442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j825h\" (UniqueName: \"kubernetes.io/projected/697a4d54-3dc7-4529-9513-ab92f02ce46b-kube-api-access-j825h\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.582139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.582120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/697a4d54-3dc7-4529-9513-ab92f02ce46b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.591202 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.591179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j825h\" (UniqueName: \"kubernetes.io/projected/697a4d54-3dc7-4529-9513-ab92f02ce46b-kube-api-access-j825h\") pod \"payload-pre-processing-7677b774bb-vls22\" (UID: \"697a4d54-3dc7-4529-9513-ab92f02ce46b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.665283 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.665206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:08.790884 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:08.790855    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-vls22"]
Jul 21 16:34:08.792190 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:34:08.792161    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697a4d54_3dc7_4529_9513_ab92f02ce46b.slice/crio-22e642a35d284f9c22113c11ed04dc33b6219f779cc6600102c7e9a2919beb28 WatchSource:0}: Error finding container 22e642a35d284f9c22113c11ed04dc33b6219f779cc6600102c7e9a2919beb28: Status 404 returned error can't find the container with id 22e642a35d284f9c22113c11ed04dc33b6219f779cc6600102c7e9a2919beb28
Jul 21 16:34:09.482049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:09.481985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:09.553288 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:09.553253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:09.558909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:09.558879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22" event={"ID":"697a4d54-3dc7-4529-9513-ab92f02ce46b","Type":"ContainerStarted","Data":"22e642a35d284f9c22113c11ed04dc33b6219f779cc6600102c7e9a2919beb28"}
Jul 21 16:34:10.574605 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:10.574513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n" event={"ID":"0f0f2dad-8724-4f43-bb95-fd1ae0e808a3","Type":"ContainerStarted","Data":"3a370331d711fcf5db462f21f520e0aa235ae2ea48e8209f053d782cc3c1bc14"}
Jul 21 16:34:10.575031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:10.574759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:10.592083 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:10.592027    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n" podStartSLOduration=1.657607392 podStartE2EDuration="3.592010553s" totalImagesPullingTime="1.934403161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:10.591621984 +0000 UTC m=+551.044177198" watchObservedRunningTime="2026-07-21 16:34:10.592010553 +0000 UTC m=+551.044565766"
Jul 21 16:34:11.580840 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:11.580799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22" event={"ID":"697a4d54-3dc7-4529-9513-ab92f02ce46b","Type":"ContainerStarted","Data":"89c1bf7363372824130506fd8c2f0e4d51ae6782e148a06ba0f0a1d8b45b62a2"}
Jul 21 16:34:11.581272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:11.581039    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:11.598239 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:11.598197    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22" podStartSLOduration=1.426692192 podStartE2EDuration="3.598182832s" totalImagesPullingTime="2.17149064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:11.597767458 +0000 UTC m=+552.050322669" watchObservedRunningTime="2026-07-21 16:34:11.598182832 +0000 UTC m=+552.050738045"
Jul 21 16:34:16.586505 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.586475    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b9ff9cd55-tct8n"
Jul 21 16:34:16.607720 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.607680    2577 generic.go:356] "Generic (PLEG): container finished" podID="408c8246-0a04-4319-a619-f9884e4e1f88" containerID="1752e3589e3d0e2cdd2295c550f0e103f14a0c33c70caa71fe0ba84f938e9482" exitCode=0
Jul 21 16:34:16.607921 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.607761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" event={"ID":"408c8246-0a04-4319-a619-f9884e4e1f88","Type":"ContainerDied","Data":"1752e3589e3d0e2cdd2295c550f0e103f14a0c33c70caa71fe0ba84f938e9482"}
Jul 21 16:34:16.608153 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.608138    2577 scope.go:117] "RemoveContainer" containerID="1752e3589e3d0e2cdd2295c550f0e103f14a0c33c70caa71fe0ba84f938e9482"
Jul 21 16:34:16.609139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.609114    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:34:16.609195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.609176    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:34:16.609234 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:16.609210    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:34:17.615499 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:17.615465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" event={"ID":"408c8246-0a04-4319-a619-f9884e4e1f88","Type":"ContainerStarted","Data":"aaaa6a24d4274ac95e0a46826c33fa5d30dccb5aa1ebe8087a6930665661a87e"}
Jul 21 16:34:18.169830 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:18.169794    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:18.274722 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:18.274690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:18.393290 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:18.393253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:34:18.394384 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:18.394356    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j78tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 16:34:18.394504 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:18.394434    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" podUID="408c8246-0a04-4319-a619-f9884e4e1f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 16:34:19.393489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:19.393452    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j78tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 16:34:19.393883 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:19.393506    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" podUID="408c8246-0a04-4319-a619-f9884e4e1f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 16:34:20.101021 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:20.100986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:34:20.394305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:20.394269    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j78tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 21 16:34:20.394694 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:20.394361    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl" podUID="408c8246-0a04-4319-a619-f9884e4e1f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 21 16:34:21.397607 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:21.397577    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:34:21.398586 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:21.398565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j78tl"
Jul 21 16:34:22.588448 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:22.588416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-vls22"
Jul 21 16:34:32.303269 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.303235    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"]
Jul 21 16:34:32.305725 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.305708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.308897 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.308874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:34:32.310247 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.310227    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 16:34:32.310378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.310252    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:34:32.310378 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.310291    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kk782\""
Jul 21 16:34:32.317426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.317401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"]
Jul 21 16:34:32.324951 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.324921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:32.397007 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.396978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.397152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.397015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.397152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.397046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.397152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.397096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.397261 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.397152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzj6\" (UniqueName: \"kubernetes.io/projected/36a36661-8b19-493e-80af-eb07f033a479-kube-api-access-5nzj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.397261 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.397195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a36661-8b19-493e-80af-eb07f033a479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.497609 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.497790 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.497790 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.497790 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.497790 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzj6\" (UniqueName: \"kubernetes.io/projected/36a36661-8b19-493e-80af-eb07f033a479-kube-api-access-5nzj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.498017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a36661-8b19-493e-80af-eb07f033a479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.498017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.497973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.498119 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.498078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.498197 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.498176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.499737 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.499720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36a36661-8b19-493e-80af-eb07f033a479-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.500138 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.500122    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36a36661-8b19-493e-80af-eb07f033a479-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.512763 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.512741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzj6\" (UniqueName: \"kubernetes.io/projected/36a36661-8b19-493e-80af-eb07f033a479-kube-api-access-5nzj6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j\" (UID: \"36a36661-8b19-493e-80af-eb07f033a479\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.616008 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.615979    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:32.749845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:32.749813    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"]
Jul 21 16:34:32.751042 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:34:32.751011    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a36661_8b19_493e_80af_eb07f033a479.slice/crio-7f91730c29c5db1d2c08409281315b791e10e7cad2f90e1e1dffe2bda84f7a7d WatchSource:0}: Error finding container 7f91730c29c5db1d2c08409281315b791e10e7cad2f90e1e1dffe2bda84f7a7d: Status 404 returned error can't find the container with id 7f91730c29c5db1d2c08409281315b791e10e7cad2f90e1e1dffe2bda84f7a7d
Jul 21 16:34:33.711207 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:33.711168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j" event={"ID":"36a36661-8b19-493e-80af-eb07f033a479","Type":"ContainerStarted","Data":"7f91730c29c5db1d2c08409281315b791e10e7cad2f90e1e1dffe2bda84f7a7d"}
Jul 21 16:34:34.717357 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:34.717304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j" event={"ID":"36a36661-8b19-493e-80af-eb07f033a479","Type":"ContainerStarted","Data":"6100ec560e00d9383b3ff23c4a6433ca93c6f02a30829955ed2da9205c574ab4"}
Jul 21 16:34:34.737901 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:34.737849    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j" podStartSLOduration=1.223390084 podStartE2EDuration="2.737832955s" totalImagesPullingTime="1.514442871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:34.734891425 +0000 UTC m=+575.187446638" watchObservedRunningTime="2026-07-21 16:34:34.737832955 +0000 UTC m=+575.190388218"
Jul 21 16:34:42.616197 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:42.616164    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:42.616578 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:42.616221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:42.628650 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:42.628627    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:42.766656 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:42.766630    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j"
Jul 21 16:34:45.789482 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:45.789420    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:34:59.009174 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:34:59.009131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:03.572251 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:35:03.572220    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:09.937830 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:35:09.937789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:10.002858 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:35:10.002820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:17.625701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:35:17.625664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:35:29.121648 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:35:29.121560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:11.082196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:11.082156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:18.114969 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.114935    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:18.697733 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.697697    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66cb946847-wqdw2"]
Jul 21 16:36:18.700173 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.700154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.709984 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.709958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66cb946847-wqdw2"]
Jul 21 16:36:18.800797 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.800770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfs6\" (UniqueName: \"kubernetes.io/projected/e119d500-4da3-42ed-a1f3-1f3cc0b76687-kube-api-access-jtfs6\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.800990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.800807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e119d500-4da3-42ed-a1f3-1f3cc0b76687-tls-cert\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.902359 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.902298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfs6\" (UniqueName: \"kubernetes.io/projected/e119d500-4da3-42ed-a1f3-1f3cc0b76687-kube-api-access-jtfs6\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.902544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.902378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e119d500-4da3-42ed-a1f3-1f3cc0b76687-tls-cert\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.905075 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.905050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e119d500-4da3-42ed-a1f3-1f3cc0b76687-tls-cert\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.912221 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.912188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfs6\" (UniqueName: \"kubernetes.io/projected/e119d500-4da3-42ed-a1f3-1f3cc0b76687-kube-api-access-jtfs6\") pod \"authorino-66cb946847-wqdw2\" (UID: \"e119d500-4da3-42ed-a1f3-1f3cc0b76687\") " pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:18.980685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:18.980595    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:19.009629 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:19.009601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66cb946847-wqdw2"
Jul 21 16:36:19.106375 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:19.106342    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:19.165732 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:19.165704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66cb946847-wqdw2"]
Jul 21 16:36:19.167485 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:36:19.167455    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode119d500_4da3_42ed_a1f3_1f3cc0b76687.slice/crio-44323f6d3eba0795e87429491dd9ad280979cca76531c14843d3cc4eb8dd34a2 WatchSource:0}: Error finding container 44323f6d3eba0795e87429491dd9ad280979cca76531c14843d3cc4eb8dd34a2: Status 404 returned error can't find the container with id 44323f6d3eba0795e87429491dd9ad280979cca76531c14843d3cc4eb8dd34a2
Jul 21 16:36:19.168946 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:19.168925    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:36:19.243925 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:19.243832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66cb946847-wqdw2" event={"ID":"e119d500-4da3-42ed-a1f3-1f3cc0b76687","Type":"ContainerStarted","Data":"44323f6d3eba0795e87429491dd9ad280979cca76531c14843d3cc4eb8dd34a2"}
Jul 21 16:36:20.134735 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.134699    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:20.231345 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.231278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:20.254491 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.253265    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66cb946847-wqdw2" event={"ID":"e119d500-4da3-42ed-a1f3-1f3cc0b76687","Type":"ContainerStarted","Data":"6bed88ff5e5602374218a16c983fedebd1e690c5369b7202ffe5c54a0d067ae8"}
Jul 21 16:36:20.277896 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.277821    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66cb946847-wqdw2" podStartSLOduration=1.938528448 podStartE2EDuration="2.277799903s" totalImagesPullingTime="339.271455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:20.274627024 +0000 UTC m=+680.727182228" watchObservedRunningTime="2026-07-21 16:36:20.277799903 +0000 UTC m=+680.730355116"
Jul 21 16:36:20.319280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.319247    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:36:20.319480 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.319457    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" podUID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" containerName="authorino" containerID="cri-o://241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca" gracePeriod=30
Jul 21 16:36:20.579880 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.579852    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:36:20.719516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.719437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert\") pod \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") "
Jul 21 16:36:20.719516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.719493    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm4wl\" (UniqueName: \"kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl\") pod \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\" (UID: \"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168\") "
Jul 21 16:36:20.721482 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.721456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl" (OuterVolumeSpecName: "kube-api-access-pm4wl") pod "76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" (UID: "76ee3a7a-fbd1-480e-a9c3-3615f7ee6168"). InnerVolumeSpecName "kube-api-access-pm4wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:20.729585 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.729556    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" (UID: "76ee3a7a-fbd1-480e-a9c3-3615f7ee6168"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:36:20.820630 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.820596    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-tls-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:36:20.820630 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:20.820627    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm4wl\" (UniqueName: \"kubernetes.io/projected/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168-kube-api-access-pm4wl\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:36:21.259635 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.259598    2577 generic.go:356] "Generic (PLEG): container finished" podID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" containerID="241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca" exitCode=0
Jul 21 16:36:21.260110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.259645    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588cf5fd6b-69dg4"
Jul 21 16:36:21.260110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.259681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" event={"ID":"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168","Type":"ContainerDied","Data":"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"}
Jul 21 16:36:21.260110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.259718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588cf5fd6b-69dg4" event={"ID":"76ee3a7a-fbd1-480e-a9c3-3615f7ee6168","Type":"ContainerDied","Data":"fc8c562472a9d6be605a62f0a5a37c39a053d335667174d2872bd335ab82dd4b"}
Jul 21 16:36:21.260110 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.259736    2577 scope.go:117] "RemoveContainer" containerID="241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"
Jul 21 16:36:21.269203 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.269137    2577 scope.go:117] "RemoveContainer" containerID="241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"
Jul 21 16:36:21.269445 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:36:21.269423    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca\": container with ID starting with 241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca not found: ID does not exist" containerID="241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"
Jul 21 16:36:21.269545 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.269452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca"} err="failed to get container status \"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca\": rpc error: code = NotFound desc = could not find container \"241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca\": container with ID starting with 241fdd1bd6670f09ccee9011eafa099cf461a97a3e2cfd618df4dda55b2b29ca not found: ID does not exist"
Jul 21 16:36:21.282913 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.282887    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:36:21.291329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:21.291286    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-588cf5fd6b-69dg4"]
Jul 21 16:36:22.108418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:22.108385    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" path="/var/lib/kubelet/pods/76ee3a7a-fbd1-480e-a9c3-3615f7ee6168/volumes"
Jul 21 16:36:53.178040 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:53.177956    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:36:53.245559 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:36:53.245524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:05.997689 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:05.997645    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:37:05.998196 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:05.997829    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" podUID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" containerName="manager" containerID="cri-o://e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0" gracePeriod=30
Jul 21 16:37:06.235937 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.235910    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:37:06.325302 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.325224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert\") pod \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") "
Jul 21 16:37:06.325481 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.325334    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f44xn\" (UniqueName: \"kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn\") pod \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\" (UID: \"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d\") "
Jul 21 16:37:06.327147 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.327113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" (UID: "c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:37:06.327282 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.327258    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn" (OuterVolumeSpecName: "kube-api-access-f44xn") pod "c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" (UID: "c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d"). InnerVolumeSpecName "kube-api-access-f44xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:37:06.426423 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.426399    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-webhook-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:37:06.426423 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.426422    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f44xn\" (UniqueName: \"kubernetes.io/projected/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d-kube-api-access-f44xn\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:37:06.487646 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.487615    2577 generic.go:356] "Generic (PLEG): container finished" podID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" containerID="e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0" exitCode=0
Jul 21 16:37:06.487798 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.487661    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-gxxc6"
Jul 21 16:37:06.487798 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.487704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" event={"ID":"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d","Type":"ContainerDied","Data":"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"}
Jul 21 16:37:06.487798 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.487756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-gxxc6" event={"ID":"c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d","Type":"ContainerDied","Data":"a4565a5086a394e0133138852f6a009f25ebe23f45374ec43e3f4f3dee0d110b"}
Jul 21 16:37:06.487798 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.487785    2577 scope.go:117] "RemoveContainer" containerID="e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"
Jul 21 16:37:06.498585 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.498568    2577 scope.go:117] "RemoveContainer" containerID="e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"
Jul 21 16:37:06.498850 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:37:06.498832    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0\": container with ID starting with e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0 not found: ID does not exist" containerID="e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"
Jul 21 16:37:06.498905 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.498859    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0"} err="failed to get container status \"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0\": rpc error: code = NotFound desc = could not find container \"e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0\": container with ID starting with e622a90315d4be6cbfd299af724b17d81298bd282792d447fa1d207acca086a0 not found: ID does not exist"
Jul 21 16:37:06.513424 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.513400    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:37:06.515295 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:06.515275    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-gxxc6"]
Jul 21 16:37:08.107623 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:08.107591    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" path="/var/lib/kubelet/pods/c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d/volumes"
Jul 21 16:37:37.652677 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:37.652643    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:37:37.760107 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:37:37.760074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:07.315925 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.315891    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:07.316305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316231    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" containerName="manager"
Jul 21 16:38:07.316305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316244    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" containerName="manager"
Jul 21 16:38:07.316305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316260    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" containerName="authorino"
Jul 21 16:38:07.316305 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316266    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" containerName="authorino"
Jul 21 16:38:07.316457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316337    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ee3a7a-fbd1-480e-a9c3-3615f7ee6168" containerName="authorino"
Jul 21 16:38:07.316457 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.316345    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f6bd74-940b-4fb0-9658-5e09d7a1fa1d" containerName="manager"
Jul 21 16:38:07.319085 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.319066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.323241 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.323220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xl2w6\""
Jul 21 16:38:07.324600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.324581    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:38:07.324701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.324619    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:38:07.337264 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.337239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:07.451494 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.451463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.451684 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.451528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqvwj\" (UniqueName: \"kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.552671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.552638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqvwj\" (UniqueName: \"kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.552781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.552721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.555140 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.555119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.565388 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.565361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqvwj\" (UniqueName: \"kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj\") pod \"maas-controller-5486b4fd5-5sfsm\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") " pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.628799 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.628775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:07.758213 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.758187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:07.759909 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:38:07.759883    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a477fb1_a94c_4d95_80a0_b386d47f52e6.slice/crio-0dd94790e021c38209bbf4075612a8858562bb017b6518b28e0e07b3a8e59c3f WatchSource:0}: Error finding container 0dd94790e021c38209bbf4075612a8858562bb017b6518b28e0e07b3a8e59c3f: Status 404 returned error can't find the container with id 0dd94790e021c38209bbf4075612a8858562bb017b6518b28e0e07b3a8e59c3f
Jul 21 16:38:07.798181 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:07.798152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" event={"ID":"1a477fb1-a94c-4d95-80a0-b386d47f52e6","Type":"ContainerStarted","Data":"0dd94790e021c38209bbf4075612a8858562bb017b6518b28e0e07b3a8e59c3f"}
Jul 21 16:38:08.804638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:08.804604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" event={"ID":"1a477fb1-a94c-4d95-80a0-b386d47f52e6","Type":"ContainerStarted","Data":"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"}
Jul 21 16:38:08.805148 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:08.804802    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:08.836429 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:08.836380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" podStartSLOduration=1.390266858 podStartE2EDuration="1.836364708s" totalImagesPullingTime="446.09785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:38:08.835236438 +0000 UTC m=+789.287791650" watchObservedRunningTime="2026-07-21 16:38:08.836364708 +0000 UTC m=+789.288919920"
Jul 21 16:38:19.811890 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:19.811859    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:24.445764 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.445678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:24.497527 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.497490    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:24.497707 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.497685    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" podUID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" containerName="manager" containerID="cri-o://3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43" gracePeriod=30
Jul 21 16:38:24.742687 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.742660    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:24.788031 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.787994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert\") pod \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") "
Jul 21 16:38:24.788218 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.788111    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqvwj\" (UniqueName: \"kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj\") pod \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\" (UID: \"1a477fb1-a94c-4d95-80a0-b386d47f52e6\") "
Jul 21 16:38:24.790129 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.790097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1a477fb1-a94c-4d95-80a0-b386d47f52e6" (UID: "1a477fb1-a94c-4d95-80a0-b386d47f52e6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:38:24.790579 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.790554    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj" (OuterVolumeSpecName: "kube-api-access-qqvwj") pod "1a477fb1-a94c-4d95-80a0-b386d47f52e6" (UID: "1a477fb1-a94c-4d95-80a0-b386d47f52e6"). InnerVolumeSpecName "kube-api-access-qqvwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:38:24.888803 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.888775    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a477fb1-a94c-4d95-80a0-b386d47f52e6-webhook-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:38:24.888803 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.888801    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqvwj\" (UniqueName: \"kubernetes.io/projected/1a477fb1-a94c-4d95-80a0-b386d47f52e6-kube-api-access-qqvwj\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:38:24.889772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.889750    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" containerID="3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43" exitCode=0
Jul 21 16:38:24.889843 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.889793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-5sfsm"
Jul 21 16:38:24.889883 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.889833    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" event={"ID":"1a477fb1-a94c-4d95-80a0-b386d47f52e6","Type":"ContainerDied","Data":"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"}
Jul 21 16:38:24.889925 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.889883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-5sfsm" event={"ID":"1a477fb1-a94c-4d95-80a0-b386d47f52e6","Type":"ContainerDied","Data":"0dd94790e021c38209bbf4075612a8858562bb017b6518b28e0e07b3a8e59c3f"}
Jul 21 16:38:24.889925 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.889905    2577 scope.go:117] "RemoveContainer" containerID="3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"
Jul 21 16:38:24.898758 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.898741    2577 scope.go:117] "RemoveContainer" containerID="3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"
Jul 21 16:38:24.899007 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:38:24.898989    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43\": container with ID starting with 3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43 not found: ID does not exist" containerID="3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"
Jul 21 16:38:24.899051 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.899015    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43"} err="failed to get container status \"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43\": rpc error: code = NotFound desc = could not find container \"3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43\": container with ID starting with 3a560c16dbbee7f152372384948aaff53f3ea8bbaaa1a64affa8cf620aeb2d43 not found: ID does not exist"
Jul 21 16:38:24.915760 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.915732    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:24.922167 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:24.922145    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-5sfsm"]
Jul 21 16:38:25.644591 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.644560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:38:25.773421 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.773385    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5486b4fd5-2wj9n"]
Jul 21 16:38:25.773725 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.773713    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" containerName="manager"
Jul 21 16:38:25.773767 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.773726    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" containerName="manager"
Jul 21 16:38:25.773806 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.773793    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" containerName="manager"
Jul 21 16:38:25.776500 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.776484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:25.786710 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.786688    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xl2w6\""
Jul 21 16:38:25.786813 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.786723    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:38:25.786813 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.786688    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:38:25.809569 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.809539    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-2wj9n"]
Jul 21 16:38:25.898655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.898573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cee787f-850f-46af-a088-d1116ac2524b-webhook-cert\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:25.898655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.898621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzcq6\" (UniqueName: \"kubernetes.io/projected/1cee787f-850f-46af-a088-d1116ac2524b-kube-api-access-lzcq6\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:25.999419 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.999365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cee787f-850f-46af-a088-d1116ac2524b-webhook-cert\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:25.999597 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:25.999458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzcq6\" (UniqueName: \"kubernetes.io/projected/1cee787f-850f-46af-a088-d1116ac2524b-kube-api-access-lzcq6\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:26.001950 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.001921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cee787f-850f-46af-a088-d1116ac2524b-webhook-cert\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:26.010497 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.010472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzcq6\" (UniqueName: \"kubernetes.io/projected/1cee787f-850f-46af-a088-d1116ac2524b-kube-api-access-lzcq6\") pod \"maas-controller-5486b4fd5-2wj9n\" (UID: \"1cee787f-850f-46af-a088-d1116ac2524b\") " pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:26.087334 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.087281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:26.107278 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.107245    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a477fb1-a94c-4d95-80a0-b386d47f52e6" path="/var/lib/kubelet/pods/1a477fb1-a94c-4d95-80a0-b386d47f52e6/volumes"
Jul 21 16:38:26.222414 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.222381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5486b4fd5-2wj9n"]
Jul 21 16:38:26.228615 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:38:26.228586    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cee787f_850f_46af_a088_d1116ac2524b.slice/crio-ed347dc2ec7eb28ab67960ce608a3fb088f056e815e6e3aa850d119e20051ac5 WatchSource:0}: Error finding container ed347dc2ec7eb28ab67960ce608a3fb088f056e815e6e3aa850d119e20051ac5: Status 404 returned error can't find the container with id ed347dc2ec7eb28ab67960ce608a3fb088f056e815e6e3aa850d119e20051ac5
Jul 21 16:38:26.904296 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:26.904267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-2wj9n" event={"ID":"1cee787f-850f-46af-a088-d1116ac2524b","Type":"ContainerStarted","Data":"ed347dc2ec7eb28ab67960ce608a3fb088f056e815e6e3aa850d119e20051ac5"}
Jul 21 16:38:27.910277 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:27.910237    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5486b4fd5-2wj9n" event={"ID":"1cee787f-850f-46af-a088-d1116ac2524b","Type":"ContainerStarted","Data":"c5ba129c844ab0846a6fd5b2e35e1ffffb24c00177f684c65c79c40b1b3d99d5"}
Jul 21 16:38:27.910719 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:27.910445    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:27.944505 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:27.940190    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5486b4fd5-2wj9n" podStartSLOduration=2.303766361 podStartE2EDuration="2.940171477s" totalImagesPullingTime="636.405116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:38:27.937522347 +0000 UTC m=+808.390077559" watchObservedRunningTime="2026-07-21 16:38:27.940171477 +0000 UTC m=+808.392726692"
Jul 21 16:38:38.917923 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:38.917836    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5486b4fd5-2wj9n"
Jul 21 16:38:55.422661 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:38:55.422609    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:07.377383 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:07.377345    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:07.519703 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:07.519670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:07.644100 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:07.644005    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:14.160287 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:14.160252    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:14.280291 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:14.280251    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:14.435506 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:14.435413    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:14.563734 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:14.563700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:20.489812 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:20.489777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:39:20.592438 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:39:20.592400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:15.695725 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:42:15.695691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:42:17.274413 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:42:17.274379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:44:15.719563 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.719532    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"]
Jul 21 16:44:15.722912 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.722895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.727896 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.727879    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qcfkb\""
Jul 21 16:44:15.738659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.738628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"]
Jul 21 16:44:15.843030 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.842982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6rz\" (UniqueName: \"kubernetes.io/projected/8ceba58e-3912-40ca-b10f-26790e6651c3-kube-api-access-8x6rz\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.843230 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.843073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ceba58e-3912-40ca-b10f-26790e6651c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.944080 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.944041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6rz\" (UniqueName: \"kubernetes.io/projected/8ceba58e-3912-40ca-b10f-26790e6651c3-kube-api-access-8x6rz\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.944282 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.944107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ceba58e-3912-40ca-b10f-26790e6651c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.944511 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.944492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ceba58e-3912-40ca-b10f-26790e6651c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:15.956078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:15.956048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6rz\" (UniqueName: \"kubernetes.io/projected/8ceba58e-3912-40ca-b10f-26790e6651c3-kube-api-access-8x6rz\") pod \"kuadrant-operator-controller-manager-86878c769f-5vndl\" (UID: \"8ceba58e-3912-40ca-b10f-26790e6651c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:16.038053 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.037965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:16.194650 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.194627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"]
Jul 21 16:44:16.195667 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:44:16.195642    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceba58e_3912_40ca_b10f_26790e6651c3.slice/crio-c7e617ff0c95c8363a4b7aa9f3fa7c1b915f4cc83e423c02356531ba467d74f8 WatchSource:0}: Error finding container c7e617ff0c95c8363a4b7aa9f3fa7c1b915f4cc83e423c02356531ba467d74f8: Status 404 returned error can't find the container with id c7e617ff0c95c8363a4b7aa9f3fa7c1b915f4cc83e423c02356531ba467d74f8
Jul 21 16:44:16.687593 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.687554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl" event={"ID":"8ceba58e-3912-40ca-b10f-26790e6651c3","Type":"ContainerStarted","Data":"fb8c6dbd5fa44bbcca178d85e9067a4a33383d35fffd8067fb46a1dba454773c"}
Jul 21 16:44:16.687802 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.687613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl" event={"ID":"8ceba58e-3912-40ca-b10f-26790e6651c3","Type":"ContainerStarted","Data":"c7e617ff0c95c8363a4b7aa9f3fa7c1b915f4cc83e423c02356531ba467d74f8"}
Jul 21 16:44:16.687802 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.687679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:16.726185 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:16.726114    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl" podStartSLOduration=1.726089817 podStartE2EDuration="1.726089817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:44:16.722627758 +0000 UTC m=+1157.175182970" watchObservedRunningTime="2026-07-21 16:44:16.726089817 +0000 UTC m=+1157.178645030"
Jul 21 16:44:27.693988 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:27.693909    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5vndl"
Jul 21 16:44:39.922516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:44:39.922480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:45:08.356777 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:45:08.356741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:46:32.319509 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:46:32.319409    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:46:54.227892 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:46:54.227841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:47:03.010433 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:47:03.010394    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:47:36.673533 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:47:36.673498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:47:38.331692 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:47:38.331650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:12.637098 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:50:12.637061    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:12.719374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:50:12.719334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:54.747489 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:50:54.747452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:50:58.166755 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:50:58.166716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:15.958627 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:15.958589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:18.809193 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:18.809134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:18.906553 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:18.906517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:19.221869 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:19.221835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.046052 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.046017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.131175 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.131139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.278272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.278241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.562034 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.562005    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:51:25.565302 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.565285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.567962 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.567946    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-989b148b-openshift-default-dockercfg-8bwwr\""
Jul 21 16:51:25.584941 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.584911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.586082 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.586057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:51:25.680972 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.680932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:25.686010 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.685986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686137 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686137 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686137 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686175    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qdtc\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686329 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.686486 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.686405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787548 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787548 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.787796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.787788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qdtc\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.788157 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.788079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.788216 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.788188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.788272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.788221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.788272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.788236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.788723 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.788699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.790001 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.789978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.790095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.790006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.795827 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.795805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.796057 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.796039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qdtc\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc\") pod \"e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") " pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:25.875730 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:25.875703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:26.011960 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.011932    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:51:26.012902 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:51:26.012871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18301b2c_0bf0_4104_80b7_9c16f1d31ceb.slice/crio-c8e83068d35b02953a6bedc956c183a66fb28e18c8ec5f8fe376ef9663ffbf0c WatchSource:0}: Error finding container c8e83068d35b02953a6bedc956c183a66fb28e18c8ec5f8fe376ef9663ffbf0c: Status 404 returned error can't find the container with id c8e83068d35b02953a6bedc956c183a66fb28e18c8ec5f8fe376ef9663ffbf0c
Jul 21 16:51:26.014911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.014879    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:26.015009 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.014957    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:26.015009 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.015003    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:26.935455 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.935420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerStarted","Data":"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"}
Jul 21 16:51:26.935860 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.935476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerStarted","Data":"c8e83068d35b02953a6bedc956c183a66fb28e18c8ec5f8fe376ef9663ffbf0c"}
Jul 21 16:51:26.959372 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:26.959320    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podStartSLOduration=1.959291159 podStartE2EDuration="1.959291159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:51:26.956617683 +0000 UTC m=+1587.409172900" watchObservedRunningTime="2026-07-21 16:51:26.959291159 +0000 UTC m=+1587.411846371"
Jul 21 16:51:27.876458 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:27.876419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:27.880769 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:27.880747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:27.941025 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:27.940995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:27.941801 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:27.941783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:28.299046 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.298950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:28.394999 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.394967    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:51:28.398744 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.398621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.398744 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.398725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:28.401396 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.401377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-989b148b-serving-cert\""
Jul 21 16:51:28.415070 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.415018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:51:28.476663 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.476632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:28.514055 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.514020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.514266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.514085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.514266 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.514178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpsp7\" (UniqueName: \"kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.585474 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.585357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:28.615205 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.615168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.615402 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.615217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.615402 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.615248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpsp7\" (UniqueName: \"kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.615849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.615829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.617675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.617658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.629123 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.629088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpsp7\" (UniqueName: \"kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7\") pod \"maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:28.710479 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:28.710433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:29.043744 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.043712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:29.057666 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.057643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:51:29.058075 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:51:29.058051    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f7fad7_3dbb_44cc_babd_013c5b8c6bb8.slice/crio-97611bac1da41b3a07c6ee1138202e44f00b3868113833ced5dac4465ef3395e WatchSource:0}: Error finding container 97611bac1da41b3a07c6ee1138202e44f00b3868113833ced5dac4465ef3395e: Status 404 returned error can't find the container with id 97611bac1da41b3a07c6ee1138202e44f00b3868113833ced5dac4465ef3395e
Jul 21 16:51:29.059597 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.059581    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:51:29.141647 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.141615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:29.952539 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.952500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" event={"ID":"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8","Type":"ContainerStarted","Data":"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"}
Jul 21 16:51:29.952736 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.952584    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:29.952736 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.952608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" event={"ID":"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8","Type":"ContainerStarted","Data":"97611bac1da41b3a07c6ee1138202e44f00b3868113833ced5dac4465ef3395e"}
Jul 21 16:51:29.974061 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:29.974012    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" podStartSLOduration=1.4968570319999999 podStartE2EDuration="1.973994611s" totalImagesPullingTime="477.137579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:51:29.971763944 +0000 UTC m=+1590.424319156" watchObservedRunningTime="2026-07-21 16:51:29.973994611 +0000 UTC m=+1590.426549822"
Jul 21 16:51:35.963825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:35.963797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:51:39.185922 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:39.185877    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:51:42.943165 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:42.943078    2577 patch_prober.go:28] interesting pod/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:51:42.943568 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:42.943154    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 21 16:51:43.019699 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.019613    2577 generic.go:356] "Generic (PLEG): container finished" podID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerID="cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c" exitCode=0
Jul 21 16:51:43.019699 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.019684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerDied","Data":"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"}
Jul 21 16:51:43.020095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.020081    2577 scope.go:117] "RemoveContainer" containerID="cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"
Jul 21 16:51:43.021058 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.021031    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:43.021129 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.021112    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:43.021197 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:43.021183    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:51:44.027803 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:44.027758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerStarted","Data":"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"}
Jul 21 16:51:44.876507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:44.876468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:44.876697 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:44.876674    2577 patch_prober.go:28] interesting pod/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:51:44.876743 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:44.876727    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 21 16:51:45.876567 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:45.876527    2577 patch_prober.go:28] interesting pod/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:51:45.876960 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:45.876584    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 21 16:51:46.876832 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:46.876792    2577 patch_prober.go:28] interesting pod/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 21 16:51:46.877240 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:46.876849    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 21 16:51:47.880251 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:47.880218    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:47.880770 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:47.880620    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:51:47.881217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:51:47.881201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:52:04.357066 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.357031    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:52:04.357527 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.357248    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" podUID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" containerName="maas-api" containerID="cri-o://efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0" gracePeriod=30
Jul 21 16:52:04.371568 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.371545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:04.607807 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.607749    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:52:04.645772 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.645747    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls\") pod \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") "
Jul 21 16:52:04.645916 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.645807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpsp7\" (UniqueName: \"kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7\") pod \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") "
Jul 21 16:52:04.645916 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.645853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca\") pod \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\" (UID: \"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8\") "
Jul 21 16:52:04.646239 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.646217    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" (UID: "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:52:04.648033 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.648008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7" (OuterVolumeSpecName: "kube-api-access-wpsp7") pod "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" (UID: "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8"). InnerVolumeSpecName "kube-api-access-wpsp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:52:04.648153 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.648049    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" (UID: "e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:52:04.747393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.747361    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:04.747393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.747390    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpsp7\" (UniqueName: \"kubernetes.io/projected/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-kube-api-access-wpsp7\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:04.747393 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:04.747400    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:05.145199 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.145164    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" containerID="efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0" exitCode=0
Jul 21 16:52:05.145199 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.145202    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"
Jul 21 16:52:05.145436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.145249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" event={"ID":"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8","Type":"ContainerDied","Data":"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"}
Jul 21 16:52:05.145436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.145293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s" event={"ID":"e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8","Type":"ContainerDied","Data":"97611bac1da41b3a07c6ee1138202e44f00b3868113833ced5dac4465ef3395e"}
Jul 21 16:52:05.145436 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.145339    2577 scope.go:117] "RemoveContainer" containerID="efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"
Jul 21 16:52:05.154849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.154832    2577 scope.go:117] "RemoveContainer" containerID="efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"
Jul 21 16:52:05.155104 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:52:05.155084    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0\": container with ID starting with efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0 not found: ID does not exist" containerID="efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"
Jul 21 16:52:05.155146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.155112    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0"} err="failed to get container status \"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0\": rpc error: code = NotFound desc = could not find container \"efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0\": container with ID starting with efcc2d3d28c366c1aa4f33e2355c43f855796cd7dedc0174552c2193f3695bd0 not found: ID does not exist"
Jul 21 16:52:05.178752 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.178726    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:52:05.182656 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:05.182636    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-989b148b-6b5bfbc5df-mnd9s"]
Jul 21 16:52:06.107218 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:06.107185    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" path="/var/lib/kubelet/pods/e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8/volumes"
Jul 21 16:52:08.937064 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:08.937032    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:09.165655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.165610    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:52:09.166008 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.165979    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy" containerID="cri-o://ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d" gracePeriod=30
Jul 21 16:52:09.191065 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.190995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:09.390988 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.390954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:09.703999 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.703969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:09.986955 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:09.986881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:10.127834 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.127802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:10.325516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.325441    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:10.325825 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.325813    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" containerName="maas-api"
Jul 21 16:52:10.325867 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.325827    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" containerName="maas-api"
Jul 21 16:52:10.325902 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.325889    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f7fad7-3dbb-44cc-babd-013c5b8c6bb8" containerName="maas-api"
Jul 21 16:52:10.329974 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.329959    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.333548 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.333525    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-512e02f1-gw-openshift-default-dockercfg-mdxtv\""
Jul 21 16:52:10.348551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.348526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:10.369418 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.369395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:10.399431 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399551 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399534    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzf5w\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399761 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399761 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.399761 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.399725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500645 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.500881 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzf5w\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.500926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.501055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501143 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.501118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.501211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501463 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.501445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.501516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.501473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.503562 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.503535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.503875 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.503853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.513511 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.513491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzf5w\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.513602 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.513541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token\") pod \"e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") " pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.640038 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.640013    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:10.779923 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.779896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:10.781377 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:52:10.781350    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af239dd_bee5_46b8_88e1_bcc03ddbc32e.slice/crio-c9877d0f19a44b557b6705e44cd0beccf089e911f469ecba464d8fdbf53647fa WatchSource:0}: Error finding container c9877d0f19a44b557b6705e44cd0beccf089e911f469ecba464d8fdbf53647fa: Status 404 returned error can't find the container with id c9877d0f19a44b557b6705e44cd0beccf089e911f469ecba464d8fdbf53647fa
Jul 21 16:52:10.783407 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.783378    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:10.783500 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.783437    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:10.783500 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.783463    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:10.803671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:10.803642    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:11.183379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:11.183340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerStarted","Data":"bee3476a8601582a2eb833db61f69cbec290e1d692bd65eebc383495001fefdd"}
Jul 21 16:52:11.183845 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:11.183399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerStarted","Data":"c9877d0f19a44b557b6705e44cd0beccf089e911f469ecba464d8fdbf53647fa"}
Jul 21 16:52:11.208674 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:11.208630    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podStartSLOduration=1.208615293 podStartE2EDuration="1.208615293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:52:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:52:11.206835073 +0000 UTC m=+1631.659390297" watchObservedRunningTime="2026-07-21 16:52:11.208615293 +0000 UTC m=+1631.661170505"
Jul 21 16:52:11.640465 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:11.640425    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:11.645265 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:11.645243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:12.189701 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:12.189673    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:12.190674 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:12.190654    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:12.694445 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:12.694416    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:12.813806 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:12.813777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:13.249938 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:13.249904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:13.361290 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:13.361260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:13.462484 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:13.462445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:14.413120 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.413093    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437003    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qdtc\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437244    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437268    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437304    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437475    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:52:14.437746 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs\") pod \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\" (UID: \"18301b2c-0bf0-4104-80b7-9c16f1d31ceb\") "
Jul 21 16:52:14.438411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.437972    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istiod-ca-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.438411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.438189    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:14.438411 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.438333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data" (OuterVolumeSpecName: "istio-data") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:14.438575 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.438428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:14.438575 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.438506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:14.439840 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.439806    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:14.440195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.440175    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token" (OuterVolumeSpecName: "istio-token") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:52:14.440691 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.440666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:52:14.441877 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.441842    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc" (OuterVolumeSpecName: "kube-api-access-9qdtc") pod "18301b2c-0bf0-4104-80b7-9c16f1d31ceb" (UID: "18301b2c-0bf0-4104-80b7-9c16f1d31ceb"). InnerVolumeSpecName "kube-api-access-9qdtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:52:14.538561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538525    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-token\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538554    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qdtc\" (UniqueName: \"kubernetes.io/projected/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-kube-api-access-9qdtc\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538561 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538565    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-socket\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538575    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-podinfo\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538583    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-data\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538591    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-credential-socket\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538598    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-workload-certs\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:14.538795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:14.538606    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18301b2c-0bf0-4104-80b7-9c16f1d31ceb-istio-envoy\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:15.208064 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.208028    2577 generic.go:356] "Generic (PLEG): container finished" podID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerID="ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d" exitCode=0
Jul 21 16:52:15.208235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.208073    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"
Jul 21 16:52:15.208235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.208113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerDied","Data":"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"}
Jul 21 16:52:15.208235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.208182    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7" event={"ID":"18301b2c-0bf0-4104-80b7-9c16f1d31ceb","Type":"ContainerDied","Data":"c8e83068d35b02953a6bedc956c183a66fb28e18c8ec5f8fe376ef9663ffbf0c"}
Jul 21 16:52:15.208235 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.208209    2577 scope.go:117] "RemoveContainer" containerID="ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"
Jul 21 16:52:15.217554 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.217536    2577 scope.go:117] "RemoveContainer" containerID="cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"
Jul 21 16:52:15.225620 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.225600    2577 scope.go:117] "RemoveContainer" containerID="ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"
Jul 21 16:52:15.225935 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:52:15.225912    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d\": container with ID starting with ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d not found: ID does not exist" containerID="ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"
Jul 21 16:52:15.225990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.225949    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d"} err="failed to get container status \"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d\": rpc error: code = NotFound desc = could not find container \"ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d\": container with ID starting with ddccb6a7bcd9fbe1ce5c754aba744da134a43e06ed8b046073f414b622ed9b4d not found: ID does not exist"
Jul 21 16:52:15.225990 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.225974    2577 scope.go:117] "RemoveContainer" containerID="cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"
Jul 21 16:52:15.226198 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:52:15.226178    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c\": container with ID starting with cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c not found: ID does not exist" containerID="cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"
Jul 21 16:52:15.226256 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.226208    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c"} err="failed to get container status \"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c\": rpc error: code = NotFound desc = could not find container \"cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c\": container with ID starting with cc7535ed8ba8e2a4a3b61be6139e76c19c4e8bb9122926c655c454a479d2451c not found: ID does not exist"
Jul 21 16:52:15.243033 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.243011    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:52:15.247396 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:15.247377    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-989b148b-openshift-default-7d6df95cd9-q4tc7"]
Jul 21 16:52:16.108696 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:16.108662    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" path="/var/lib/kubelet/pods/18301b2c-0bf0-4104-80b7-9c16f1d31ceb/volumes"
Jul 21 16:52:26.275343 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.275289    2577 generic.go:356] "Generic (PLEG): container finished" podID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerID="bee3476a8601582a2eb833db61f69cbec290e1d692bd65eebc383495001fefdd" exitCode=0
Jul 21 16:52:26.275694 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.275337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerDied","Data":"bee3476a8601582a2eb833db61f69cbec290e1d692bd65eebc383495001fefdd"}
Jul 21 16:52:26.275694 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.275676    2577 scope.go:117] "RemoveContainer" containerID="bee3476a8601582a2eb833db61f69cbec290e1d692bd65eebc383495001fefdd"
Jul 21 16:52:26.276713 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.276688    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:26.276771 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.276757    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:26.276811 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:26.276790    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 16:52:27.190286 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:27.190239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:27.282655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:27.282620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerStarted","Data":"d809973145f863c0bdbc24b0848fb31bc86b108f9bc2c8ce94b9cf1a80c0645e"}
Jul 21 16:52:27.640219 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:27.640177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:27.641570 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:27.641539    2577 patch_prober.go:28] interesting pod/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:52:27.641710 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:27.641593    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 16:52:28.641087 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:28.641040    2577 patch_prober.go:28] interesting pod/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:52:28.641605 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:28.641111    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 16:52:29.641098 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:29.641052    2577 patch_prober.go:28] interesting pod/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:52:29.641614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:29.641119    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 16:52:30.640501 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:30.640461    2577 patch_prober.go:28] interesting pod/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 16:52:30.640726 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:30.640543    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 16:52:31.644685 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:31.644655    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:31.645142 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:31.644954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:31.645659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:31.645638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:48.564139 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:48.564092    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:53.078081 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.078044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:53.277619 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.277577    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:53.277865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.277838    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy" containerID="cri-o://d809973145f863c0bdbc24b0848fb31bc86b108f9bc2c8ce94b9cf1a80c0645e" gracePeriod=30
Jul 21 16:52:53.359754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.359719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:53.537861 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.537827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:53.768194 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:53.768101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:54.357666 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:54.357629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:54.619875 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:54.619789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:58.445003 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.444971    2577 generic.go:356] "Generic (PLEG): container finished" podID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerID="d809973145f863c0bdbc24b0848fb31bc86b108f9bc2c8ce94b9cf1a80c0645e" exitCode=0
Jul 21 16:52:58.445398 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.445035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerDied","Data":"d809973145f863c0bdbc24b0848fb31bc86b108f9bc2c8ce94b9cf1a80c0645e"}
Jul 21 16:52:58.445398 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.445098    2577 scope.go:117] "RemoveContainer" containerID="bee3476a8601582a2eb833db61f69cbec290e1d692bd65eebc383495001fefdd"
Jul 21 16:52:58.541544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.541485    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:58.639849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639820    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.639849 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzf5w\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639877    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639960    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.639994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640099 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640056    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data\") pod \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\" (UID: \"7af239dd-bee5-46b8-88e1-bcc03ddbc32e\") "
Jul 21 16:52:58.640507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640342    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:58.640507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:58.640507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:58.640507 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.640485    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:52:58.641124 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.641099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:58.642108 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.642084    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 16:52:58.642300 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.642282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w" (OuterVolumeSpecName: "kube-api-access-xzf5w") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "kube-api-access-xzf5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:52:58.642496 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.642471    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:52:58.642496 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.642477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7af239dd-bee5-46b8-88e1-bcc03ddbc32e" (UID: "7af239dd-bee5-46b8-88e1-bcc03ddbc32e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:52:58.741049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741014    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-envoy\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741044    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzf5w\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-kube-api-access-xzf5w\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741055    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-podinfo\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741063    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istiod-ca-cert\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741071    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-credential-socket\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741079    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-certs\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741087    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-workload-socket\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741095    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-token\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:58.741350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:58.741103    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7af239dd-bee5-46b8-88e1-bcc03ddbc32e-istio-data\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:52:59.451114 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.451085    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"
Jul 21 16:52:59.451638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.451131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf" event={"ID":"7af239dd-bee5-46b8-88e1-bcc03ddbc32e","Type":"ContainerDied","Data":"c9877d0f19a44b557b6705e44cd0beccf089e911f469ecba464d8fdbf53647fa"}
Jul 21 16:52:59.451638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.451189    2577 scope.go:117] "RemoveContainer" containerID="d809973145f863c0bdbc24b0848fb31bc86b108f9bc2c8ce94b9cf1a80c0645e"
Jul 21 16:52:59.493587 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.493553    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:59.504785 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.504751    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-512e02f1-gw-openshift-default-7c97f5494c-bzdcf"]
Jul 21 16:52:59.530648 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.530614    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:59.702381 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.702268    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:52:59.893463 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:52:59.893428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:00.107554 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:00.107523    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" path="/var/lib/kubelet/pods/7af239dd-bee5-46b8-88e1-bcc03ddbc32e/volumes"
Jul 21 16:53:00.219901 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:00.219865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:00.711343 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:00.711302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:00.818227 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:00.818182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:35.796868 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:35.796820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:40.400932 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:40.400892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:41.606254 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:41.606223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:41.835204 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:41.835172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:42.103078 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:42.102941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:42.494130 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:42.494096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:42.776943 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:42.776859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:44.808482 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:44.808453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:44.912399 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:44.912370    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.046022 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.045988    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:53:45.046385 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046371    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:53:45.046437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046386    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:53:45.046437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046397    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.046437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046402    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.046437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046412    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.046437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046418    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.046591 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046472    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:53:45.046591 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046480    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.046591 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.046488    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7af239dd-bee5-46b8-88e1-bcc03ddbc32e" containerName="istio-proxy"
Jul 21 16:53:45.049543 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.049525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.054969 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.054942    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9f938885-serving-cert\""
Jul 21 16:53:45.064516 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.064453    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:53:45.080443 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.080412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.142956 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.142925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.143128 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.142962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.143128 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.143057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttltn\" (UniqueName: \"kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.243739 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.243699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttltn\" (UniqueName: \"kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.243911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.243779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.243911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.243805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.243983 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:53:45.243922    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-serving-cert: secret "maas-api-e2e-derive-9f938885-serving-cert" not found
Jul 21 16:53:45.244026 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:53:45.244004    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls podName:9248af41-b1ec-43ed-9412-815ab89bcfba nodeName:}" failed. No retries permitted until 2026-07-21 16:53:45.743984151 +0000 UTC m=+1726.196539350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls") pod "maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" (UID: "9248af41-b1ec-43ed-9412-815ab89bcfba") : secret "maas-api-e2e-derive-9f938885-serving-cert" not found
Jul 21 16:53:45.244482 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.244464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.257926 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.257896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttltn\" (UniqueName: \"kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.586514 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.586479    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.688945 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.688904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.747160 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.747129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.749671 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.749650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") pod \"maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:45.787950 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.787907    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:45.960010 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:45.959973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:46.096437 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:46.096412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:53:46.097925 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:53:46.097890    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9248af41_b1ec_43ed_9412_815ab89bcfba.slice/crio-c86e0b0797e915b38e0d8b5c0569bfeefebeda8c70deff6c4b47648690a44392 WatchSource:0}: Error finding container c86e0b0797e915b38e0d8b5c0569bfeefebeda8c70deff6c4b47648690a44392: Status 404 returned error can't find the container with id c86e0b0797e915b38e0d8b5c0569bfeefebeda8c70deff6c4b47648690a44392
Jul 21 16:53:46.697294 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:46.697263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" event={"ID":"9248af41-b1ec-43ed-9412-815ab89bcfba","Type":"ContainerStarted","Data":"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"}
Jul 21 16:53:46.697432 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:46.697333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" event={"ID":"9248af41-b1ec-43ed-9412-815ab89bcfba","Type":"ContainerStarted","Data":"c86e0b0797e915b38e0d8b5c0569bfeefebeda8c70deff6c4b47648690a44392"}
Jul 21 16:53:46.697432 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:46.697357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:53:46.717974 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:46.717924    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" podStartSLOduration=1.190050164 podStartE2EDuration="1.717907929s" totalImagesPullingTime="527.857765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:53:46.715964056 +0000 UTC m=+1727.168519269" watchObservedRunningTime="2026-07-21 16:53:46.717907929 +0000 UTC m=+1727.170463141"
Jul 21 16:53:47.499119 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:47.499086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:47.597640 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:47.597605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:53:52.708370 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:53:52.708342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:54:06.388508 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:06.388478    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:06.490280 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:06.490244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:20.109483 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.109453    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:54:20.110050 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.109688    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" podUID="9248af41-b1ec-43ed-9412-815ab89bcfba" containerName="maas-api" containerID="cri-o://bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47" gracePeriod=30
Jul 21 16:54:20.136182 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.136153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:20.356112 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.356092    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:54:20.441653 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.441568    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttltn\" (UniqueName: \"kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn\") pod \"9248af41-b1ec-43ed-9412-815ab89bcfba\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") "
Jul 21 16:54:20.441653 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.441627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca\") pod \"9248af41-b1ec-43ed-9412-815ab89bcfba\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") "
Jul 21 16:54:20.441836 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.441703    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") pod \"9248af41-b1ec-43ed-9412-815ab89bcfba\" (UID: \"9248af41-b1ec-43ed-9412-815ab89bcfba\") "
Jul 21 16:54:20.442007 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.441983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9248af41-b1ec-43ed-9412-815ab89bcfba" (UID: "9248af41-b1ec-43ed-9412-815ab89bcfba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:54:20.443704 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.443672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9248af41-b1ec-43ed-9412-815ab89bcfba" (UID: "9248af41-b1ec-43ed-9412-815ab89bcfba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:54:20.443808 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.443716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn" (OuterVolumeSpecName: "kube-api-access-ttltn") pod "9248af41-b1ec-43ed-9412-815ab89bcfba" (UID: "9248af41-b1ec-43ed-9412-815ab89bcfba"). InnerVolumeSpecName "kube-api-access-ttltn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:54:20.542779 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.542748    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttltn\" (UniqueName: \"kubernetes.io/projected/9248af41-b1ec-43ed-9412-815ab89bcfba-kube-api-access-ttltn\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:54:20.542779 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.542774    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9248af41-b1ec-43ed-9412-815ab89bcfba-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:54:20.542779 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.542784    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9248af41-b1ec-43ed-9412-815ab89bcfba-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:54:20.871681 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.871650    2577 generic.go:356] "Generic (PLEG): container finished" podID="9248af41-b1ec-43ed-9412-815ab89bcfba" containerID="bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47" exitCode=0
Jul 21 16:54:20.871853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.871694    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"
Jul 21 16:54:20.871853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.871724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" event={"ID":"9248af41-b1ec-43ed-9412-815ab89bcfba","Type":"ContainerDied","Data":"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"}
Jul 21 16:54:20.871853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.871765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm" event={"ID":"9248af41-b1ec-43ed-9412-815ab89bcfba","Type":"ContainerDied","Data":"c86e0b0797e915b38e0d8b5c0569bfeefebeda8c70deff6c4b47648690a44392"}
Jul 21 16:54:20.871853 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.871786    2577 scope.go:117] "RemoveContainer" containerID="bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"
Jul 21 16:54:20.881569 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.881483    2577 scope.go:117] "RemoveContainer" containerID="bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"
Jul 21 16:54:20.882832 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:54:20.882801    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47\": container with ID starting with bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47 not found: ID does not exist" containerID="bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"
Jul 21 16:54:20.882937 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.882875    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47"} err="failed to get container status \"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47\": rpc error: code = NotFound desc = could not find container \"bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47\": container with ID starting with bab46f1638b717a90f958d22c79e663f58af0d7b06b84ad8c49aeea98ffcfb47 not found: ID does not exist"
Jul 21 16:54:20.894013 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.893991    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:54:20.897384 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:20.897363    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9f938885-9b45fbb45-l7pzm"]
Jul 21 16:54:22.107522 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:22.107486    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9248af41-b1ec-43ed-9412-815ab89bcfba" path="/var/lib/kubelet/pods/9248af41-b1ec-43ed-9412-815ab89bcfba/volumes"
Jul 21 16:54:24.752117 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:24.752087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:24.919321 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:24.919286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:25.156403 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:25.156365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:25.647146 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:25.647112    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:25.744722 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:25.744685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:25.844782 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:25.844750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:27.195824 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:27.195788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.089164 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:33.089126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.192831 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:33.192791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.291045 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:33.291007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.387600 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:33.387567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:33.797763 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:33.797681    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:54:59.707115 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:54:59.707082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:06.495838 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:06.495793    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:06.593909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:06.593855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:06.692586 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:06.692553    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:22.533546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:22.533509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:28.212035 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:28.211998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:28.313016 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:28.312953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:28.411381 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:28.411344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:38.885281 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:38.885248    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:39.700578 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:39.700524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:46.146420 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:46.146380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:46.264222 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:46.264189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:46.358675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:46.358640    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:46.451692 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:46.451607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:47.206360 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:47.206297    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:47.308005 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:47.307962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:47.404118 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:47.404091    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:55:54.142021 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:55:54.141986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:00.756017 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:00.755983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:00.817337 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:00.817291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:01.405395 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:01.405361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:07.453297 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:07.453254    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:07.517188 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:07.517153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:07.677638 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:07.677602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:08.082855 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:08.082814    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:09.184503 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:09.184421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:11.169498 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.169462    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:11.269272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.269236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:11.408107 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408071    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:11.408624 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408609    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:56:11.408698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408658    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:56:11.408698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408673    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9248af41-b1ec-43ed-9412-815ab89bcfba" containerName="maas-api"
Jul 21 16:56:11.408698 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408683    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9248af41-b1ec-43ed-9412-815ab89bcfba" containerName="maas-api"
Jul 21 16:56:11.408854 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408841    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9248af41-b1ec-43ed-9412-815ab89bcfba" containerName="maas-api"
Jul 21 16:56:11.408891 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.408857    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="18301b2c-0bf0-4104-80b7-9c16f1d31ceb" containerName="istio-proxy"
Jul 21 16:56:11.412090 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.412070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.414842 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.414825    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-afe3d8e0-serving-cert\""
Jul 21 16:56:11.423892 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.423836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:11.432055 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.432032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8sp\" (UniqueName: \"kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.432272 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.432248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.432376 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.432327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.446582 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.446560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:11.532480 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.532444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:11.532796 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.532778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.532851 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.532834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8sp\" (UniqueName: \"kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.532918 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.532906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.533644 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.533617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.535279 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.535261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.541007 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.540990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8sp\" (UniqueName: \"kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp\") pod \"maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.723473 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.723386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:11.862258 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:11.862232    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:11.864361 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:56:11.864335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237c10bb_e5c7_463a_9cf7_fb11119683c8.slice/crio-2400a597927bc4fde0d646a8b424a6d63275df176408ca49da4119ff03339731 WatchSource:0}: Error finding container 2400a597927bc4fde0d646a8b424a6d63275df176408ca49da4119ff03339731: Status 404 returned error can't find the container with id 2400a597927bc4fde0d646a8b424a6d63275df176408ca49da4119ff03339731
Jul 21 16:56:12.451556 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.451518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" event={"ID":"237c10bb-e5c7-463a-9cf7-fb11119683c8","Type":"ContainerStarted","Data":"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"}
Jul 21 16:56:12.451909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.451612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" event={"ID":"237c10bb-e5c7-463a-9cf7-fb11119683c8","Type":"ContainerStarted","Data":"2400a597927bc4fde0d646a8b424a6d63275df176408ca49da4119ff03339731"}
Jul 21 16:56:12.451909 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.451648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:12.470054 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.470007    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" podStartSLOduration=0.961360916 podStartE2EDuration="1.469992195s" totalImagesPullingTime="508.631279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:12.468755579 +0000 UTC m=+1872.921310792" watchObservedRunningTime="2026-07-21 16:56:12.469992195 +0000 UTC m=+1872.922547407"
Jul 21 16:56:12.782220 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.782137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:12.834547 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:12.834437    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:15.663302 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:15.663265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:16.360491 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:16.360460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:16.482666 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:16.482631    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:16.790998 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:16.790912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:18.462374 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:18.462345    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:22.836426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:22.836337    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:22.946190 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:22.946156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:33.665212 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:33.665183    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:33.665757 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:33.665400    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" podUID="237c10bb-e5c7-463a-9cf7-fb11119683c8" containerName="maas-api" containerID="cri-o://aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0" gracePeriod=30
Jul 21 16:56:33.689926 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:33.689880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:33.914902 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:33.914878    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:34.042544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.042462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca\") pod \"237c10bb-e5c7-463a-9cf7-fb11119683c8\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") "
Jul 21 16:56:34.042544 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.042508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh8sp\" (UniqueName: \"kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp\") pod \"237c10bb-e5c7-463a-9cf7-fb11119683c8\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") "
Jul 21 16:56:34.042752 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.042569    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls\") pod \"237c10bb-e5c7-463a-9cf7-fb11119683c8\" (UID: \"237c10bb-e5c7-463a-9cf7-fb11119683c8\") "
Jul 21 16:56:34.042926 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.042895    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "237c10bb-e5c7-463a-9cf7-fb11119683c8" (UID: "237c10bb-e5c7-463a-9cf7-fb11119683c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:34.044721 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.044666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp" (OuterVolumeSpecName: "kube-api-access-sh8sp") pod "237c10bb-e5c7-463a-9cf7-fb11119683c8" (UID: "237c10bb-e5c7-463a-9cf7-fb11119683c8"). InnerVolumeSpecName "kube-api-access-sh8sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:56:34.044815 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.044757    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "237c10bb-e5c7-463a-9cf7-fb11119683c8" (UID: "237c10bb-e5c7-463a-9cf7-fb11119683c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:56:34.143394 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.143366    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237c10bb-e5c7-463a-9cf7-fb11119683c8-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:56:34.143394 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.143390    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh8sp\" (UniqueName: \"kubernetes.io/projected/237c10bb-e5c7-463a-9cf7-fb11119683c8-kube-api-access-sh8sp\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:56:34.143394 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.143400    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237c10bb-e5c7-463a-9cf7-fb11119683c8-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:56:34.564886 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.564851    2577 generic.go:356] "Generic (PLEG): container finished" podID="237c10bb-e5c7-463a-9cf7-fb11119683c8" containerID="aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0" exitCode=0
Jul 21 16:56:34.565095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.564905    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"
Jul 21 16:56:34.565095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.564938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" event={"ID":"237c10bb-e5c7-463a-9cf7-fb11119683c8","Type":"ContainerDied","Data":"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"}
Jul 21 16:56:34.565095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.565025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml" event={"ID":"237c10bb-e5c7-463a-9cf7-fb11119683c8","Type":"ContainerDied","Data":"2400a597927bc4fde0d646a8b424a6d63275df176408ca49da4119ff03339731"}
Jul 21 16:56:34.565095 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.565056    2577 scope.go:117] "RemoveContainer" containerID="aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"
Jul 21 16:56:34.575960 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.575936    2577 scope.go:117] "RemoveContainer" containerID="aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"
Jul 21 16:56:34.576289 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:56:34.576268    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0\": container with ID starting with aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0 not found: ID does not exist" containerID="aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"
Jul 21 16:56:34.576379 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.576297    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0"} err="failed to get container status \"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0\": rpc error: code = NotFound desc = could not find container \"aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0\": container with ID starting with aec8f13b09cede7e67855fc446cbbe632336a6977e729790bad089283edae6b0 not found: ID does not exist"
Jul 21 16:56:34.584410 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.584389    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:34.588573 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:34.588553    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-afe3d8e0-64589f6ccc-zwwml"]
Jul 21 16:56:36.107713 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:36.107680    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="237c10bb-e5c7-463a-9cf7-fb11119683c8" path="/var/lib/kubelet/pods/237c10bb-e5c7-463a-9cf7-fb11119683c8/volumes"
Jul 21 16:56:38.271525 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:38.271491    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:38.661244 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:38.661209    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:44.467446 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:44.467411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:44.567953 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:44.567909    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:44.774754 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:44.774670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:45.008016 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:45.007981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:45.119978 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:45.119949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:45.219496 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:45.219465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:45.330051 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:45.330002    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.337795 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:51.337752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.450152 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:51.450120    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.560226 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:51.560185    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:51.717077 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:51.717045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:57.731506 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:57.731472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:56:57.831415 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:56:57.831385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:06.620049 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:06.620008    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:06.956325 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:06.956231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:07.788968 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:07.788932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:09.483406 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.483361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:09.593759 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.593719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:09.605248 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.605205    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:57:09.605807 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.605784    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237c10bb-e5c7-463a-9cf7-fb11119683c8" containerName="maas-api"
Jul 21 16:57:09.605907 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.605810    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="237c10bb-e5c7-463a-9cf7-fb11119683c8" containerName="maas-api"
Jul 21 16:57:09.605907 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.605903    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="237c10bb-e5c7-463a-9cf7-fb11119683c8" containerName="maas-api"
Jul 21 16:57:09.609613 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.609592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.612614 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.612595    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e336b700-serving-cert\""
Jul 21 16:57:09.619555 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.619529    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:57:09.669665 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.669633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.669856 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.669710    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqnx\" (UniqueName: \"kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.669856 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.669778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.694216 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.694179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:09.771248 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.771154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.771248 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.771230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.771478 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:57:09.771279    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-serving-cert: secret "maas-api-e2e-mt-e336b700-serving-cert" not found
Jul 21 16:57:09.771478 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:57:09.771380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls podName:bac523cd-b8db-4cff-85b6-10ae36ef5aef nodeName:}" failed. No retries permitted until 2026-07-21 16:57:10.271358733 +0000 UTC m=+1930.723913925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls") pod "maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" (UID: "bac523cd-b8db-4cff-85b6-10ae36ef5aef") : secret "maas-api-e2e-mt-e336b700-serving-cert" not found
Jul 21 16:57:09.771478 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.771405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqnx\" (UniqueName: \"kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.772047 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.772021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:09.788257 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:09.788227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqnx\" (UniqueName: \"kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:10.049217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.049135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:10.276688 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.276643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:10.279174 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.279148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") pod \"maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:10.427550 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.427482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:10.520601 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.520567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:10.610719 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.610687    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:10.678886 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.678858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:57:10.680367 ip-10-0-141-38 kubenswrapper[2577]: W0721 16:57:10.680339    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac523cd_b8db_4cff_85b6_10ae36ef5aef.slice/crio-cbdf8133c2b7c27dd54b2b338f1603f1bc931c79425a3577167ea4553b1923a0 WatchSource:0}: Error finding container cbdf8133c2b7c27dd54b2b338f1603f1bc931c79425a3577167ea4553b1923a0: Status 404 returned error can't find the container with id cbdf8133c2b7c27dd54b2b338f1603f1bc931c79425a3577167ea4553b1923a0
Jul 21 16:57:10.681609 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.681588    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:57:10.755986 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:10.755945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" event={"ID":"bac523cd-b8db-4cff-85b6-10ae36ef5aef","Type":"ContainerStarted","Data":"cbdf8133c2b7c27dd54b2b338f1603f1bc931c79425a3577167ea4553b1923a0"}
Jul 21 16:57:11.767243 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:11.767205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" event={"ID":"bac523cd-b8db-4cff-85b6-10ae36ef5aef","Type":"ContainerStarted","Data":"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"}
Jul 21 16:57:11.767672 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:11.767403    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:11.791331 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:11.791240    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" podStartSLOduration=2.274854618 podStartE2EDuration="2.791225012s" totalImagesPullingTime="516.370394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:57:11.790111773 +0000 UTC m=+1932.242667009" watchObservedRunningTime="2026-07-21 16:57:11.791225012 +0000 UTC m=+1932.243780224"
Jul 21 16:57:13.957350 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:13.957278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:57:17.778299 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:17.778270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:57:40.628655 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:57:40.628619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:23.389390 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.389354    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:58:23.389948 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.389662    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" podUID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" containerName="maas-api" containerID="cri-o://ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1" gracePeriod=30
Jul 21 16:58:23.428006 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.427969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:23.634651 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.634624    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:58:23.718858 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.718772    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") pod \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") "
Jul 21 16:58:23.718858 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.718852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzqnx\" (UniqueName: \"kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx\") pod \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") "
Jul 21 16:58:23.719048 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.718901    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca\") pod \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\" (UID: \"bac523cd-b8db-4cff-85b6-10ae36ef5aef\") "
Jul 21 16:58:23.719363 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.719291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bac523cd-b8db-4cff-85b6-10ae36ef5aef" (UID: "bac523cd-b8db-4cff-85b6-10ae36ef5aef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:58:23.720865 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.720837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bac523cd-b8db-4cff-85b6-10ae36ef5aef" (UID: "bac523cd-b8db-4cff-85b6-10ae36ef5aef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:58:23.721008 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.720988    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx" (OuterVolumeSpecName: "kube-api-access-xzqnx") pod "bac523cd-b8db-4cff-85b6-10ae36ef5aef" (UID: "bac523cd-b8db-4cff-85b6-10ae36ef5aef"). InnerVolumeSpecName "kube-api-access-xzqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:58:23.819741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.819707    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bac523cd-b8db-4cff-85b6-10ae36ef5aef-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:58:23.819741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.819735    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzqnx\" (UniqueName: \"kubernetes.io/projected/bac523cd-b8db-4cff-85b6-10ae36ef5aef-kube-api-access-xzqnx\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:58:23.819741 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:23.819747    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bac523cd-b8db-4cff-85b6-10ae36ef5aef-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 16:58:24.139710 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.139679    2577 generic.go:356] "Generic (PLEG): container finished" podID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" containerID="ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1" exitCode=0
Jul 21 16:58:24.139911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.139736    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"
Jul 21 16:58:24.139911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.139767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" event={"ID":"bac523cd-b8db-4cff-85b6-10ae36ef5aef","Type":"ContainerDied","Data":"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"}
Jul 21 16:58:24.139911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.139831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g" event={"ID":"bac523cd-b8db-4cff-85b6-10ae36ef5aef","Type":"ContainerDied","Data":"cbdf8133c2b7c27dd54b2b338f1603f1bc931c79425a3577167ea4553b1923a0"}
Jul 21 16:58:24.139911 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.139864    2577 scope.go:117] "RemoveContainer" containerID="ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"
Jul 21 16:58:24.148481 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.148463    2577 scope.go:117] "RemoveContainer" containerID="ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"
Jul 21 16:58:24.148758 ip-10-0-141-38 kubenswrapper[2577]: E0721 16:58:24.148736    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1\": container with ID starting with ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1 not found: ID does not exist" containerID="ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"
Jul 21 16:58:24.148821 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.148767    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1"} err="failed to get container status \"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1\": rpc error: code = NotFound desc = could not find container \"ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1\": container with ID starting with ba17f2b3ae2551975a05eaa49fe40591c97bfdebeb5cb09640b31dcef0a207f1 not found: ID does not exist"
Jul 21 16:58:24.160408 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.160382    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:58:24.166066 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:24.166044    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e336b700-8f78c7ffc-cc68g"]
Jul 21 16:58:26.106964 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:26.106929    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" path="/var/lib/kubelet/pods/bac523cd-b8db-4cff-85b6-10ae36ef5aef/volumes"
Jul 21 16:58:28.009963 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:28.009916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:30.270745 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:30.270711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:35.360714 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:35.360670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:48.306481 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:48.306440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:58:48.403735 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:58:48.403688    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:11.912552 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:11.912509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:12.835262 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:12.835227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:17.990195 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:17.990145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:19.391546 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:19.391504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:19.491217 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:19.491188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:19.748675 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:19.748584    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:19.988157 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:19.988110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.132659 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:21.132620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.212426 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:21.212394    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:21.319179 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:21.319082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:22.199440 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:22.199411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:22.288726 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:22.288694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:23.848726 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:23.848685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:30.837131 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:30.837084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:30.941461 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:30.941421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:31.586794 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:31.586762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:34.136528 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:34.136496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.241553 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:39.241522    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.381781 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:39.381736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:39.670570 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:39.670520    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:50.142687 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:50.142645    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 16:59:50.511007 ip-10-0-141-38 kubenswrapper[2577]: I0721 16:59:50.510917    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:11.521234 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:11.521193    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:18.431291 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:18.431243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:18.531440 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:18.531403    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:18.777835 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:18.777741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:19.184747 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:19.184707    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:19.382452 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:19.382418    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:22.521949 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.521912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:22.621406 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.621375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:22.785685 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.785609    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:00:22.785983 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.785971    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" containerName="maas-api"
Jul 21 17:00:22.786037 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.785984    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" containerName="maas-api"
Jul 21 17:00:22.786076 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.786051    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac523cd-b8db-4cff-85b6-10ae36ef5aef" containerName="maas-api"
Jul 21 17:00:22.789289 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.789269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.792139 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.792104    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4a9a8c-serving-cert\""
Jul 21 17:00:22.800745 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.800719    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:00:22.820945 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.820916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:22.865645 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.865613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.865834 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.865655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v72f\" (UniqueName: \"kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.865834 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.865728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.966963 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.966916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.967172 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.967081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.967172 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.967132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v72f\" (UniqueName: \"kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.967172 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:00:22.967089    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-serving-cert: secret "maas-api-e2e-inf-a-4a9a8c-serving-cert" not found
Jul 21 17:00:22.967401 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:00:22.967232    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls podName:31ed83e1-55e0-4f50-8935-054ea4e63625 nodeName:}" failed. No retries permitted until 2026-07-21 17:00:23.467213655 +0000 UTC m=+2123.919768845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls") pod "maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" (UID: "31ed83e1-55e0-4f50-8935-054ea4e63625") : secret "maas-api-e2e-inf-a-4a9a8c-serving-cert" not found
Jul 21 17:00:22.967776 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.967752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:22.976232 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:22.976206    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v72f\" (UniqueName: \"kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:23.125788 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.125749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:23.329400 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.329362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:23.432414 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.432303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:23.472580 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.472542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:23.475196 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.475164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") pod \"maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:23.700785 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.700689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:23.838370 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:23.838339    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:00:23.839753 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:00:23.839728    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ed83e1_55e0_4f50_8935_054ea4e63625.slice/crio-6df26e97a1223f4e64b19f350ea6ab5cacfdd0b189dd5823ecd5f7978c8fc071 WatchSource:0}: Error finding container 6df26e97a1223f4e64b19f350ea6ab5cacfdd0b189dd5823ecd5f7978c8fc071: Status 404 returned error can't find the container with id 6df26e97a1223f4e64b19f350ea6ab5cacfdd0b189dd5823ecd5f7978c8fc071
Jul 21 17:00:24.769895 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:24.769857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" event={"ID":"31ed83e1-55e0-4f50-8935-054ea4e63625","Type":"ContainerStarted","Data":"d3e3e5f1e5eb4fbc88961137f435a66955ef7d1555fd218b6263a6539c031064"}
Jul 21 17:00:24.770355 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:24.769908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" event={"ID":"31ed83e1-55e0-4f50-8935-054ea4e63625","Type":"ContainerStarted","Data":"6df26e97a1223f4e64b19f350ea6ab5cacfdd0b189dd5823ecd5f7978c8fc071"}
Jul 21 17:00:24.770355 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:24.770029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:24.801390 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:24.801338    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" podStartSLOduration=2.332037869 podStartE2EDuration="2.801297343s" totalImagesPullingTime="469.259474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:24.801050137 +0000 UTC m=+2125.253605351" watchObservedRunningTime="2026-07-21 17:00:24.801297343 +0000 UTC m=+2125.253852555"
Jul 21 17:00:27.015332 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:27.015270    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:27.361511 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:27.361482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:28.002108 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:28.002061    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:28.233033 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:28.232995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:30.544327 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.544271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:30.630159 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.630119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:30.631289 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.631262    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:00:30.634709 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.634690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.638631 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.638613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1a8da1-serving-cert\""
Jul 21 17:00:30.646804 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.646779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:00:30.709140 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.709106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:30.737619 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.737582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwtm\" (UniqueName: \"kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.737619 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.737618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.737846 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.737654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.781587 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.781559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:00:30.839198 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.839105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwtm\" (UniqueName: \"kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.839198 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.839157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.839447 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.839199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.840078 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.840052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.841594 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.841568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.849750 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.849722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwtm\" (UniqueName: \"kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm\") pod \"maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:30.871740 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.871711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:30.948183 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:30.948141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:31.085665 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.085636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:00:31.086925 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:00:31.086902    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef28e08_0381_4697_ab3e_80f7507d335c.slice/crio-1f41732459ddc790caafd8889826bdf91aa1bdd6e21a6c105cf5f1a4dd6e5a97 WatchSource:0}: Error finding container 1f41732459ddc790caafd8889826bdf91aa1bdd6e21a6c105cf5f1a4dd6e5a97: Status 404 returned error can't find the container with id 1f41732459ddc790caafd8889826bdf91aa1bdd6e21a6c105cf5f1a4dd6e5a97
Jul 21 17:00:31.223176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.223144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:31.325278 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.325247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:31.809647 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.809547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" event={"ID":"def28e08-0381-4697-ab3e-80f7507d335c","Type":"ContainerStarted","Data":"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"}
Jul 21 17:00:31.809647 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.809606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" event={"ID":"def28e08-0381-4697-ab3e-80f7507d335c","Type":"ContainerStarted","Data":"1f41732459ddc790caafd8889826bdf91aa1bdd6e21a6c105cf5f1a4dd6e5a97"}
Jul 21 17:00:31.810079 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.809660    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:31.827402 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:31.827343    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" podStartSLOduration=1.504317152 podStartE2EDuration="1.827305137s" totalImagesPullingTime="322.987985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:31.826607946 +0000 UTC m=+2132.279163159" watchObservedRunningTime="2026-07-21 17:00:31.827305137 +0000 UTC m=+2132.279860351"
Jul 21 17:00:35.297900 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:35.297862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:37.821304 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:37.821267    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:00:44.866613 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:44.866576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:45.805822 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:45.805779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:45.905227 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:45.905179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:52.142915 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:52.142835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:52.259721 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:52.259691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:00:55.080354 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:00:55.080295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:10.338113 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:01:10.338055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:50.388815 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:01:50.388740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:50.482699 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:01:50.482670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:51.291832 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:01:51.291771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:01:51.390683 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:01:51.390649    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:01.133810 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.133775    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:02:01.134202 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.133994    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" podUID="31ed83e1-55e0-4f50-8935-054ea4e63625" containerName="maas-api" containerID="cri-o://d3e3e5f1e5eb4fbc88961137f435a66955ef7d1555fd218b6263a6539c031064" gracePeriod=30
Jul 21 17:02:01.153887 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.153854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:01.283546 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.283509    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ed83e1-55e0-4f50-8935-054ea4e63625" containerID="d3e3e5f1e5eb4fbc88961137f435a66955ef7d1555fd218b6263a6539c031064" exitCode=0
Jul 21 17:02:01.283721 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.283581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" event={"ID":"31ed83e1-55e0-4f50-8935-054ea4e63625","Type":"ContainerDied","Data":"d3e3e5f1e5eb4fbc88961137f435a66955ef7d1555fd218b6263a6539c031064"}
Jul 21 17:02:01.385385 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.385325    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:02:01.446566 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.446532    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v72f\" (UniqueName: \"kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f\") pod \"31ed83e1-55e0-4f50-8935-054ea4e63625\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") "
Jul 21 17:02:01.446764 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.446606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca\") pod \"31ed83e1-55e0-4f50-8935-054ea4e63625\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") "
Jul 21 17:02:01.446764 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.446626    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") pod \"31ed83e1-55e0-4f50-8935-054ea4e63625\" (UID: \"31ed83e1-55e0-4f50-8935-054ea4e63625\") "
Jul 21 17:02:01.446990 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.446965    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31ed83e1-55e0-4f50-8935-054ea4e63625" (UID: "31ed83e1-55e0-4f50-8935-054ea4e63625"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:02:01.448655 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.448622    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f" (OuterVolumeSpecName: "kube-api-access-6v72f") pod "31ed83e1-55e0-4f50-8935-054ea4e63625" (UID: "31ed83e1-55e0-4f50-8935-054ea4e63625"). InnerVolumeSpecName "kube-api-access-6v72f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:01.448756 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.448665    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31ed83e1-55e0-4f50-8935-054ea4e63625" (UID: "31ed83e1-55e0-4f50-8935-054ea4e63625"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:02:01.548084 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.548049    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v72f\" (UniqueName: \"kubernetes.io/projected/31ed83e1-55e0-4f50-8935-054ea4e63625-kube-api-access-6v72f\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:01.548084 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.548077    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31ed83e1-55e0-4f50-8935-054ea4e63625-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:01.548084 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:01.548087    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31ed83e1-55e0-4f50-8935-054ea4e63625-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:02.289533 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:02.289505    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"
Jul 21 17:02:02.289997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:02.289553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx" event={"ID":"31ed83e1-55e0-4f50-8935-054ea4e63625","Type":"ContainerDied","Data":"6df26e97a1223f4e64b19f350ea6ab5cacfdd0b189dd5823ecd5f7978c8fc071"}
Jul 21 17:02:02.289997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:02.289620    2577 scope.go:117] "RemoveContainer" containerID="d3e3e5f1e5eb4fbc88961137f435a66955ef7d1555fd218b6263a6539c031064"
Jul 21 17:02:02.313849 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:02.313817    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:02:02.318273 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:02.318247    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4a9a8c-5468449f97-h7hvx"]
Jul 21 17:02:04.107237 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:04.107202    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ed83e1-55e0-4f50-8935-054ea4e63625" path="/var/lib/kubelet/pods/31ed83e1-55e0-4f50-8935-054ea4e63625/volumes"
Jul 21 17:02:05.699370 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:05.699334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:06.203993 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:06.203957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:13.306129 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:13.306095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:13.406912 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:13.406881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:14.082850 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:14.082817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:14.310476 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:14.310442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:23.716946 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:23.716865    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:02:23.717630 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:23.717077    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" podUID="def28e08-0381-4697-ab3e-80f7507d335c" containerName="maas-api" containerID="cri-o://1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba" gracePeriod=30
Jul 21 17:02:23.742085 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:23.742057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:23.967762 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:23.967704    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:02:24.044447 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.044414    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls\") pod \"def28e08-0381-4697-ab3e-80f7507d335c\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") "
Jul 21 17:02:24.044597 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.044474    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca\") pod \"def28e08-0381-4697-ab3e-80f7507d335c\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") "
Jul 21 17:02:24.044597 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.044540    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlwtm\" (UniqueName: \"kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm\") pod \"def28e08-0381-4697-ab3e-80f7507d335c\" (UID: \"def28e08-0381-4697-ab3e-80f7507d335c\") "
Jul 21 17:02:24.044844 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.044811    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "def28e08-0381-4697-ab3e-80f7507d335c" (UID: "def28e08-0381-4697-ab3e-80f7507d335c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:02:24.046580 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.046558    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "def28e08-0381-4697-ab3e-80f7507d335c" (UID: "def28e08-0381-4697-ab3e-80f7507d335c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:02:24.046641 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.046604    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm" (OuterVolumeSpecName: "kube-api-access-xlwtm") pod "def28e08-0381-4697-ab3e-80f7507d335c" (UID: "def28e08-0381-4697-ab3e-80f7507d335c"). InnerVolumeSpecName "kube-api-access-xlwtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:24.145540 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.145511    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/def28e08-0381-4697-ab3e-80f7507d335c-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:24.145687 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.145555    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/def28e08-0381-4697-ab3e-80f7507d335c-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:24.145687 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.145566    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlwtm\" (UniqueName: \"kubernetes.io/projected/def28e08-0381-4697-ab3e-80f7507d335c-kube-api-access-xlwtm\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:02:24.408474 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.408440    2577 generic.go:356] "Generic (PLEG): container finished" podID="def28e08-0381-4697-ab3e-80f7507d335c" containerID="1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba" exitCode=0
Jul 21 17:02:24.408666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.408500    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"
Jul 21 17:02:24.408666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.408518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" event={"ID":"def28e08-0381-4697-ab3e-80f7507d335c","Type":"ContainerDied","Data":"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"}
Jul 21 17:02:24.408666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.408595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk" event={"ID":"def28e08-0381-4697-ab3e-80f7507d335c","Type":"ContainerDied","Data":"1f41732459ddc790caafd8889826bdf91aa1bdd6e21a6c105cf5f1a4dd6e5a97"}
Jul 21 17:02:24.408666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.408620    2577 scope.go:117] "RemoveContainer" containerID="1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"
Jul 21 17:02:24.417126 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.417110    2577 scope.go:117] "RemoveContainer" containerID="1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"
Jul 21 17:02:24.417379 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:02:24.417361    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba\": container with ID starting with 1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba not found: ID does not exist" containerID="1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"
Jul 21 17:02:24.417427 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.417386    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba"} err="failed to get container status \"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba\": rpc error: code = NotFound desc = could not find container \"1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba\": container with ID starting with 1b1ececdcb6e78ceb619242ad0c13e9807998e49b9ef7e2057c6d036678e9eba not found: ID does not exist"
Jul 21 17:02:24.427280 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.427257    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:02:24.432270 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:24.432249    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a8da1-5c5d95b98-k9pdk"]
Jul 21 17:02:26.108520 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:26.108489    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def28e08-0381-4697-ab3e-80f7507d335c" path="/var/lib/kubelet/pods/def28e08-0381-4697-ab3e-80f7507d335c/volumes"
Jul 21 17:02:28.318581 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:28.318548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:29.314339 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:29.314286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:34.632232 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:34.632200    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:34.694537 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:34.694504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:34.906194 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:34.906112    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:35.117664 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:35.117632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:35.436895 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:35.436861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:35.755714 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:35.755635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:35.854594 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:35.854559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.435980 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.435944    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.607528 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.607488    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:02:38.608045 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ed83e1-55e0-4f50-8935-054ea4e63625" containerName="maas-api"
Jul 21 17:02:38.608090 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608050    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ed83e1-55e0-4f50-8935-054ea4e63625" containerName="maas-api"
Jul 21 17:02:38.608090 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608080    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def28e08-0381-4697-ab3e-80f7507d335c" containerName="maas-api"
Jul 21 17:02:38.608090 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608088    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="def28e08-0381-4697-ab3e-80f7507d335c" containerName="maas-api"
Jul 21 17:02:38.608193 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608184    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ed83e1-55e0-4f50-8935-054ea4e63625" containerName="maas-api"
Jul 21 17:02:38.608224 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.608199    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="def28e08-0381-4697-ab3e-80f7507d335c" containerName="maas-api"
Jul 21 17:02:38.610927 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.610906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.615611 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.615591    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-44c780-serving-cert\""
Jul 21 17:02:38.638874 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.638836    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.639045 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.638872    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:02:38.756544 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.756444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.773754 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.773723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.773914 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.773772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.773914 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.773816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfgbh\" (UniqueName: \"kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.874710 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.874669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.874710 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.874716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.874931 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.874823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfgbh\" (UniqueName: \"kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.875466 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.875444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.877137 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.877116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.887234 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.887217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfgbh\" (UniqueName: \"kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh\") pod \"maas-api-e2e-api-a-44c780-7944545554-cdph6\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:38.914022 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.913992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:38.920797 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:38.920777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:39.072343 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:39.072294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:02:39.073191 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:02:39.073169    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode842b837_e142_437e_98e9_bf9150706210.slice/crio-34dc08172d33474f2c3171cd97ef24628d17ff5848ce48eede0bbf25146f9f2a WatchSource:0}: Error finding container 34dc08172d33474f2c3171cd97ef24628d17ff5848ce48eede0bbf25146f9f2a: Status 404 returned error can't find the container with id 34dc08172d33474f2c3171cd97ef24628d17ff5848ce48eede0bbf25146f9f2a
Jul 21 17:02:39.074967 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:39.074947    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:02:39.478247 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:39.478207    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:39.487584 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:39.487550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" event={"ID":"e842b837-e142-437e-98e9-bf9150706210","Type":"ContainerStarted","Data":"34dc08172d33474f2c3171cd97ef24628d17ff5848ce48eede0bbf25146f9f2a"}
Jul 21 17:02:39.608026 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:39.607990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:40.493749 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:40.493712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" event={"ID":"e842b837-e142-437e-98e9-bf9150706210","Type":"ContainerStarted","Data":"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"}
Jul 21 17:02:40.494143 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:40.493777    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:40.519966 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:40.519915    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" podStartSLOduration=1.796624974 podStartE2EDuration="2.519899361s" totalImagesPullingTime="723.274387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:40.517375426 +0000 UTC m=+2260.969930637" watchObservedRunningTime="2026-07-21 17:02:40.519899361 +0000 UTC m=+2260.972454573"
Jul 21 17:02:42.967855 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:42.967822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:43.414193 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:43.414161    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:43.758042 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:43.757966    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:43.977984 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:43.977947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.423374 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.423339    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.505023 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.504997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:02:46.525824 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.525789    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:02:46.529626 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.529607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.536454 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.536428    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a04cd4-serving-cert\""
Jul 21 17:02:46.555724 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.555705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:02:46.589895 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.589867    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.641681 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.641648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.641832 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.641684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.641832 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.641703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5bfz\" (UniqueName: \"kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.718889 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.718810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.743056 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.743022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.743217 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.743066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.743217 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.743092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5bfz\" (UniqueName: \"kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.743805 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.743784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.745668 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.745646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.758153 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.758129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5bfz\" (UniqueName: \"kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz\") pod \"maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.841163 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.841122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:46.845190 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.845163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:46.994045 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:46.994021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:02:46.995878 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:02:46.995851    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e777bb_d8c3_4af4_9204_66c42ed0fd05.slice/crio-4adffee293dad4418bafacf22160bc73e3cb28a8b117944b987df4547ae061b6 WatchSource:0}: Error finding container 4adffee293dad4418bafacf22160bc73e3cb28a8b117944b987df4547ae061b6: Status 404 returned error can't find the container with id 4adffee293dad4418bafacf22160bc73e3cb28a8b117944b987df4547ae061b6
Jul 21 17:02:47.381677 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.381646    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:47.472611 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.472561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:47.535428 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.535391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" event={"ID":"d9e777bb-d8c3-4af4-9204-66c42ed0fd05","Type":"ContainerStarted","Data":"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"}
Jul 21 17:02:47.535619 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.535444    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" event={"ID":"d9e777bb-d8c3-4af4-9204-66c42ed0fd05","Type":"ContainerStarted","Data":"4adffee293dad4418bafacf22160bc73e3cb28a8b117944b987df4547ae061b6"}
Jul 21 17:02:47.535619 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.535475    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:47.560367 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:47.560298    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" podStartSLOduration=1.2052793529999999 podStartE2EDuration="1.560278802s" totalImagesPullingTime="354.999449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:47.559524468 +0000 UTC m=+2268.012079682" watchObservedRunningTime="2026-07-21 17:02:47.560278802 +0000 UTC m=+2268.012834015"
Jul 21 17:02:50.997148 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:50.997113    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:02:53.546876 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:53.546848    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:02:59.697497 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:02:59.697456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:00.263102 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:00.263071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:08.498283 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:08.498241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:10.315680 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:10.315639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:10.441555 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:10.441518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:14.956469 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:14.956429    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:03:14.957007 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:14.956649    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" podUID="e842b837-e142-437e-98e9-bf9150706210" containerName="maas-api" containerID="cri-o://65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb" gracePeriod=30
Jul 21 17:03:14.989662 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:14.989632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:15.202243 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.202218    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:03:15.303465 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.303384    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca\") pod \"e842b837-e142-437e-98e9-bf9150706210\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") "
Jul 21 17:03:15.303465 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.303416    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls\") pod \"e842b837-e142-437e-98e9-bf9150706210\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") "
Jul 21 17:03:15.303685 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.303470    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfgbh\" (UniqueName: \"kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh\") pod \"e842b837-e142-437e-98e9-bf9150706210\" (UID: \"e842b837-e142-437e-98e9-bf9150706210\") "
Jul 21 17:03:15.303866 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.303835    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e842b837-e142-437e-98e9-bf9150706210" (UID: "e842b837-e142-437e-98e9-bf9150706210"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:03:15.305522 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.305491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e842b837-e142-437e-98e9-bf9150706210" (UID: "e842b837-e142-437e-98e9-bf9150706210"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:03:15.305616 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.305580    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh" (OuterVolumeSpecName: "kube-api-access-vfgbh") pod "e842b837-e142-437e-98e9-bf9150706210" (UID: "e842b837-e142-437e-98e9-bf9150706210"). InnerVolumeSpecName "kube-api-access-vfgbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:03:15.404432 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.404392    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e842b837-e142-437e-98e9-bf9150706210-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:15.404432 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.404425    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e842b837-e142-437e-98e9-bf9150706210-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:15.404432 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.404434    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfgbh\" (UniqueName: \"kubernetes.io/projected/e842b837-e142-437e-98e9-bf9150706210-kube-api-access-vfgbh\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:15.683296 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.683259    2577 generic.go:356] "Generic (PLEG): container finished" podID="e842b837-e142-437e-98e9-bf9150706210" containerID="65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb" exitCode=0
Jul 21 17:03:15.683491 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.683321    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"
Jul 21 17:03:15.683491 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.683346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" event={"ID":"e842b837-e142-437e-98e9-bf9150706210","Type":"ContainerDied","Data":"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"}
Jul 21 17:03:15.683491 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.683404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6" event={"ID":"e842b837-e142-437e-98e9-bf9150706210","Type":"ContainerDied","Data":"34dc08172d33474f2c3171cd97ef24628d17ff5848ce48eede0bbf25146f9f2a"}
Jul 21 17:03:15.683491 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.683428    2577 scope.go:117] "RemoveContainer" containerID="65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"
Jul 21 17:03:15.692694 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.692672    2577 scope.go:117] "RemoveContainer" containerID="65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"
Jul 21 17:03:15.692950 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:03:15.692929    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb\": container with ID starting with 65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb not found: ID does not exist" containerID="65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"
Jul 21 17:03:15.693014 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.692958    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb"} err="failed to get container status \"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb\": rpc error: code = NotFound desc = could not find container \"65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb\": container with ID starting with 65ff395dd3bfd6a02d1e6da81071f2bca64918e1bccaed728287d31b629101bb not found: ID does not exist"
Jul 21 17:03:15.705713 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.705689    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:03:15.711436 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:15.711410    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-44c780-7944545554-cdph6"]
Jul 21 17:03:16.107341 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:16.107294    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e842b837-e142-437e-98e9-bf9150706210" path="/var/lib/kubelet/pods/e842b837-e142-437e-98e9-bf9150706210/volumes"
Jul 21 17:03:19.218468 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:19.218412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:19.624629 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:19.624587    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:25.853823 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:25.853789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:27.401162 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:27.401131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:42.060848 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.060814    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:03:42.061380 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.061011    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" podUID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" containerName="maas-api" containerID="cri-o://07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a" gracePeriod=30
Jul 21 17:03:42.091609 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.091582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:42.313120 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.313060    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:03:42.337029 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.336996    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca\") pod \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") "
Jul 21 17:03:42.337183 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.337060    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls\") pod \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") "
Jul 21 17:03:42.337183 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.337113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5bfz\" (UniqueName: \"kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz\") pod \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\" (UID: \"d9e777bb-d8c3-4af4-9204-66c42ed0fd05\") "
Jul 21 17:03:42.339331 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.337978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9e777bb-d8c3-4af4-9204-66c42ed0fd05" (UID: "d9e777bb-d8c3-4af4-9204-66c42ed0fd05"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:03:42.346890 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.345411    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9e777bb-d8c3-4af4-9204-66c42ed0fd05" (UID: "d9e777bb-d8c3-4af4-9204-66c42ed0fd05"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:03:42.347216 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.347185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz" (OuterVolumeSpecName: "kube-api-access-j5bfz") pod "d9e777bb-d8c3-4af4-9204-66c42ed0fd05" (UID: "d9e777bb-d8c3-4af4-9204-66c42ed0fd05"). InnerVolumeSpecName "kube-api-access-j5bfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:03:42.438830 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.438792    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5bfz\" (UniqueName: \"kubernetes.io/projected/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-kube-api-access-j5bfz\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:42.438830 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.438830    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:42.438993 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.438849    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9e777bb-d8c3-4af4-9204-66c42ed0fd05-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:03:42.822708 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.822672    2577 generic.go:356] "Generic (PLEG): container finished" podID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" containerID="07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a" exitCode=0
Jul 21 17:03:42.822905 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.822730    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"
Jul 21 17:03:42.822905 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.822756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" event={"ID":"d9e777bb-d8c3-4af4-9204-66c42ed0fd05","Type":"ContainerDied","Data":"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"}
Jul 21 17:03:42.822905 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.822842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq" event={"ID":"d9e777bb-d8c3-4af4-9204-66c42ed0fd05","Type":"ContainerDied","Data":"4adffee293dad4418bafacf22160bc73e3cb28a8b117944b987df4547ae061b6"}
Jul 21 17:03:42.822905 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.822868    2577 scope.go:117] "RemoveContainer" containerID="07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"
Jul 21 17:03:42.832949 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.832922    2577 scope.go:117] "RemoveContainer" containerID="07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"
Jul 21 17:03:42.833215 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:03:42.833195    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a\": container with ID starting with 07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a not found: ID does not exist" containerID="07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"
Jul 21 17:03:42.833291 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.833221    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a"} err="failed to get container status \"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a\": rpc error: code = NotFound desc = could not find container \"07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a\": container with ID starting with 07b73f0a58a080b4f6b4526c468cd32c67895550e963706394d8a7a1d8e82a7a not found: ID does not exist"
Jul 21 17:03:42.845252 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.845217    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:03:42.848781 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:42.848757    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a04cd4-778bc7f487-wd5lq"]
Jul 21 17:03:44.107557 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:44.107526    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" path="/var/lib/kubelet/pods/d9e777bb-d8c3-4af4-9204-66c42ed0fd05/volumes"
Jul 21 17:03:46.619186 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:46.619150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:47.047747 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:47.047664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.218864 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:49.218819    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:49.319265 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:49.319230    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:53.471017 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:53.470914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:53.580021 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:53.579992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:53.786341 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:53.786229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:54.031367 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:54.031331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:55.021861 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:55.021816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:55.123325 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:55.123266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:57.871824 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:57.871777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:58.002632 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.002598    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:03:58.002954 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.002942    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e842b837-e142-437e-98e9-bf9150706210" containerName="maas-api"
Jul 21 17:03:58.002997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.002956    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e842b837-e142-437e-98e9-bf9150706210" containerName="maas-api"
Jul 21 17:03:58.002997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.002984    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" containerName="maas-api"
Jul 21 17:03:58.002997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.002990    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" containerName="maas-api"
Jul 21 17:03:58.003094 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.003043    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e777bb-d8c3-4af4-9204-66c42ed0fd05" containerName="maas-api"
Jul 21 17:03:58.003094 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.003051    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e842b837-e142-437e-98e9-bf9150706210" containerName="maas-api"
Jul 21 17:03:58.007632 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.007616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.011801 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.011776    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-07bb43-serving-cert\""
Jul 21 17:03:58.031169 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.031146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:03:58.075977 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.075950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.076112 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.076028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.076112 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.076061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4jjr\" (UniqueName: \"kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.107305 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.107271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:58.177095 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.177003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.177095 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.177040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4jjr\" (UniqueName: \"kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.177369 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.177109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.177808 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.177776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.179411 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.179393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.188071 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.188050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4jjr\" (UniqueName: \"kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr\") pod \"maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.200096 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.200071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:58.299395 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.299366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:58.318039 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.318012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:58.451303 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.451273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:03:58.452168 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:03:58.452123    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28eb833c_90af_48c5_b03b_55fce18f5fa2.slice/crio-cda414105bc2e2a4f6d3553cb45b4c67007a6660fd47b6b914ce4ae9613d3eaa WatchSource:0}: Error finding container cda414105bc2e2a4f6d3553cb45b4c67007a6660fd47b6b914ce4ae9613d3eaa: Status 404 returned error can't find the container with id cda414105bc2e2a4f6d3553cb45b4c67007a6660fd47b6b914ce4ae9613d3eaa
Jul 21 17:03:58.908867 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:58.908831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" event={"ID":"28eb833c-90af-48c5-b03b-55fce18f5fa2","Type":"ContainerStarted","Data":"cda414105bc2e2a4f6d3553cb45b4c67007a6660fd47b6b914ce4ae9613d3eaa"}
Jul 21 17:03:59.069897 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:59.069858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:59.130382 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:59.130333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:03:59.914919 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:59.914888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" event={"ID":"28eb833c-90af-48c5-b03b-55fce18f5fa2","Type":"ContainerStarted","Data":"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"}
Jul 21 17:03:59.915384 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:59.914973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:03:59.935054 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:03:59.934999    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" podStartSLOduration=1.879973788 podStartE2EDuration="2.934981319s" totalImagesPullingTime="1.055007531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:59.932706354 +0000 UTC m=+2340.385261565" watchObservedRunningTime="2026-07-21 17:03:59.934981319 +0000 UTC m=+2340.387536532"
Jul 21 17:04:02.452544 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:02.452505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:02.629266 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:02.629237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:02.963754 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:02.963666    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:03.064098 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:03.064063    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:05.913560 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:05.913509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:05.925326 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:05.925287    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:04:05.990171 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:05.990141    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:04:05.993921 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:05.993876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:05.996621 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:05.996602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1e5534-serving-cert\""
Jul 21 17:04:06.005617 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.005597    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:04:06.034243 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.034216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.052468 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.052439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rr55\" (UniqueName: \"kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.052666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.052520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.052666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.052548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.134119 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.134080    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.153962 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.153934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rr55\" (UniqueName: \"kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.154113 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.153995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.154113 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.154025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.154624 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.154601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.156434 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.156415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.164368 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.164299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rr55\" (UniqueName: \"kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55\") pod \"maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.234372 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.234336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.305482 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.305455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:06.443749 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.443722    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:04:06.444375 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:04:06.444344    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c3a416_1371_483f_8836_39a55d35507f.slice/crio-dd5257c029408b9e793886a9d5ea5c346528c3a599e95926284dc23c51589158 WatchSource:0}: Error finding container dd5257c029408b9e793886a9d5ea5c346528c3a599e95926284dc23c51589158: Status 404 returned error can't find the container with id dd5257c029408b9e793886a9d5ea5c346528c3a599e95926284dc23c51589158
Jul 21 17:04:06.532429 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.532393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.635204 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.635176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:06.952287 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:06.952254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" event={"ID":"80c3a416-1371-483f-8836-39a55d35507f","Type":"ContainerStarted","Data":"dd5257c029408b9e793886a9d5ea5c346528c3a599e95926284dc23c51589158"}
Jul 21 17:04:07.959525 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:07.959486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" event={"ID":"80c3a416-1371-483f-8836-39a55d35507f","Type":"ContainerStarted","Data":"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"}
Jul 21 17:04:07.959917 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:07.959633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:07.978372 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:07.978290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" podStartSLOduration=2.179604766 podStartE2EDuration="2.978277248s" totalImagesPullingTime="798.672482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:07.978132574 +0000 UTC m=+2348.430687798" watchObservedRunningTime="2026-07-21 17:04:07.978277248 +0000 UTC m=+2348.430832480"
Jul 21 17:04:10.309004 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:10.308960    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:13.969669 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:13.969636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:04:19.427103 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:19.427065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:19.525653 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:19.525621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:19.628529 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:19.628494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:28.331088 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:28.331010    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:28.431668 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:28.431633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:04:39.219627 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:04:39.219545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:23.691954 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:05:23.691873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:05:43.227456 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:05:43.227412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:27.303011 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:27.302976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:41.135147 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:41.135109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:41.908861 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:41.908829    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:52.201542 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.201500    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:06:52.204828 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.204806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.207686 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.207662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"openshift-service-ca.crt\""
Jul 21 17:06:52.208982 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.208957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"default-dockercfg-mg7hf\""
Jul 21 17:06:52.209107 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.208995    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"sub-test-model-07bb43-kserve-self-signed-certs\""
Jul 21 17:06:52.209107 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.209054    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"kube-root-ca.crt\""
Jul 21 17:06:52.217116 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.217095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:06:52.295967 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.295921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:06:52.319844 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.319822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.319977 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.319858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.319977 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.319888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.320053 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.319991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfb7\" (UniqueName: \"kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.320053 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.320027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.320121 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.320051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.420636 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.420795 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.420795 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfb7\" (UniqueName: \"kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.420795 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.420795 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.421019 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.420825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.421078 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.421036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.421136 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.421078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.421187 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.421160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.422843 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.422824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.423129 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.423112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.429473 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.429449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfb7\" (UniqueName: \"kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7\") pod \"sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") " pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.514288 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.514212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:06:52.652203 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:06:52.652166    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod623ae729_a9b3_489f_8407_b49e1582315d.slice/crio-725fbd8a9059539824fb2162ed3acad9725b739455686d49aaad401bc0516894 WatchSource:0}: Error finding container 725fbd8a9059539824fb2162ed3acad9725b739455686d49aaad401bc0516894: Status 404 returned error can't find the container with id 725fbd8a9059539824fb2162ed3acad9725b739455686d49aaad401bc0516894
Jul 21 17:06:52.652342 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.652224    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:06:52.813872 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.813782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" event={"ID":"623ae729-a9b3-489f-8407-b49e1582315d","Type":"ContainerStarted","Data":"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"}
Jul 21 17:06:52.813872 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.813823    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" event={"ID":"623ae729-a9b3-489f-8407-b49e1582315d","Type":"ContainerStarted","Data":"725fbd8a9059539824fb2162ed3acad9725b739455686d49aaad401bc0516894"}
Jul 21 17:06:52.834027 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:06:52.833973    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" podStartSLOduration=0.833957838 podStartE2EDuration="833.957838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:52.833610526 +0000 UTC m=+2513.286165740" watchObservedRunningTime="2026-07-21 17:06:52.833957838 +0000 UTC m=+2513.286513051"
Jul 21 17:07:02.515119 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:07:02.515077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:07:02.515704 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:07:02.515155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:07:02.527595 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:07:02.527565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:07:02.878870 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:07:02.878835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:07:31.616804 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:07:31.616768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:50.307513 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:08:50.307478    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:08:51.680508 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:08:51.680474    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:07.532348 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:07.532279    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:07.615392 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:07.615294    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:09:07.637532 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:07.637504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:08.544400 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:08.544369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:16.097674 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:16.097625    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.438921 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:20.438875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:20.536605 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:20.536571    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:22.635246 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.635204    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" podUID="623ae729-a9b3-489f-8407-b49e1582315d" containerName="main" containerID="cri-o://3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50" gracePeriod=45
Jul 21 17:09:22.880765 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.880741    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:09:22.974031 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.973946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974031 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974009    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974254 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974254 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974254 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974150    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgfb7\" (UniqueName: \"kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974254 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974192    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir\") pod \"623ae729-a9b3-489f-8407-b49e1582315d\" (UID: \"623ae729-a9b3-489f-8407-b49e1582315d\") "
Jul 21 17:09:22.974483 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974260    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache" (OuterVolumeSpecName: "model-cache") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:22.974483 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974267    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home" (OuterVolumeSpecName: "home") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:22.974588 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974481    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:22.974588 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974525    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-model-cache\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:22.974588 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.974544    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-home\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:22.976334 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.976296    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm" (OuterVolumeSpecName: "dshm") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:22.976416 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.976396    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:09:22.976460 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:22.976449    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7" (OuterVolumeSpecName: "kube-api-access-vgfb7") pod "623ae729-a9b3-489f-8407-b49e1582315d" (UID: "623ae729-a9b3-489f-8407-b49e1582315d"). InnerVolumeSpecName "kube-api-access-vgfb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:09:23.075781 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.075738    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-dshm\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.075781 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.075772    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623ae729-a9b3-489f-8407-b49e1582315d-tls-certs\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.075781 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.075787    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgfb7\" (UniqueName: \"kubernetes.io/projected/623ae729-a9b3-489f-8407-b49e1582315d-kube-api-access-vgfb7\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.076010 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.075800    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/623ae729-a9b3-489f-8407-b49e1582315d-tmp-dir\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.595443 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.595408    2577 generic.go:356] "Generic (PLEG): container finished" podID="623ae729-a9b3-489f-8407-b49e1582315d" containerID="3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50" exitCode=0
Jul 21 17:09:23.595650 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.595452    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"
Jul 21 17:09:23.595650 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.595491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" event={"ID":"623ae729-a9b3-489f-8407-b49e1582315d","Type":"ContainerDied","Data":"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"}
Jul 21 17:09:23.595650 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.595534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" event={"ID":"623ae729-a9b3-489f-8407-b49e1582315d","Type":"ContainerDied","Data":"725fbd8a9059539824fb2162ed3acad9725b739455686d49aaad401bc0516894"}
Jul 21 17:09:23.595650 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.595551    2577 scope.go:117] "RemoveContainer" containerID="3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"
Jul 21 17:09:23.605194 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.605168    2577 scope.go:117] "RemoveContainer" containerID="3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"
Jul 21 17:09:23.605465 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:09:23.605444    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50\": container with ID starting with 3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50 not found: ID does not exist" containerID="3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"
Jul 21 17:09:23.605546 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.605478    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50"} err="failed to get container status \"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50\": rpc error: code = NotFound desc = could not find container \"3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50\": container with ID starting with 3845debd5efd6c6a30e7eff238c4f4d71ee325161d9edb4bf0b3141fc6c45f50 not found: ID does not exist"
Jul 21 17:09:23.619683 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.619662    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:09:23.624856 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:23.624835    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d"]
Jul 21 17:09:24.107685 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:24.107651    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623ae729-a9b3-489f-8407-b49e1582315d" path="/var/lib/kubelet/pods/623ae729-a9b3-489f-8407-b49e1582315d/volumes"
Jul 21 17:09:27.868047 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:27.867994    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-07bb43/sub-test-model-07bb43-kserve-6d9cd7c49f-zv49d" podUID="623ae729-a9b3-489f-8407-b49e1582315d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.65:8000/ready\": context deadline exceeded"
Jul 21 17:09:29.107544 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:29.107506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:29.209773 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:29.209742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:09:30.625132 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:09:30.625087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:12.704556 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:10:12.704514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:52.506091 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:10:52.506057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:56.558181 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:10:56.558147    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:10:57.404648 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:10:57.404606    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:01.166680 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.166636    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325663280"]
Jul 21 17:11:01.167215 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.167194    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623ae729-a9b3-489f-8407-b49e1582315d" containerName="main"
Jul 21 17:11:01.167301 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.167218    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="623ae729-a9b3-489f-8407-b49e1582315d" containerName="main"
Jul 21 17:11:01.167402 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.167328    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="623ae729-a9b3-489f-8407-b49e1582315d" containerName="main"
Jul 21 17:11:01.169849 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.169828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:01.172508 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.172487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ntrxf\""
Jul 21 17:11:01.177063 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.177035    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325663280"]
Jul 21 17:11:01.233360 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.233305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd97l\" (UniqueName: \"kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l\") pod \"test-curl-7791-139884325663280\" (UID: \"b19971d3-1168-48be-84c1-e06b57a19431\") " pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:01.334091 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.334057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd97l\" (UniqueName: \"kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l\") pod \"test-curl-7791-139884325663280\" (UID: \"b19971d3-1168-48be-84c1-e06b57a19431\") " pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:01.343549 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.343520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd97l\" (UniqueName: \"kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l\") pod \"test-curl-7791-139884325663280\" (UID: \"b19971d3-1168-48be-84c1-e06b57a19431\") " pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:01.481438 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.481349    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:01.620286 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.620261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325663280"]
Jul 21 17:11:01.621737 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:11:01.621706    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb19971d3_1168_48be_84c1_e06b57a19431.slice/crio-1d2fe936907266bd9b4220556879f5760873c07b468d891fb8ce58cab1158269 WatchSource:0}: Error finding container 1d2fe936907266bd9b4220556879f5760873c07b468d891fb8ce58cab1158269: Status 404 returned error can't find the container with id 1d2fe936907266bd9b4220556879f5760873c07b468d891fb8ce58cab1158269
Jul 21 17:11:01.623103 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:01.623083    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:11:02.107493 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:02.107457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325663280" event={"ID":"b19971d3-1168-48be-84c1-e06b57a19431","Type":"ContainerStarted","Data":"1d2fe936907266bd9b4220556879f5760873c07b468d891fb8ce58cab1158269"}
Jul 21 17:11:03.111997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:03.111962    2577 generic.go:356] "Generic (PLEG): container finished" podID="b19971d3-1168-48be-84c1-e06b57a19431" containerID="62150cf591f8f4eb4527c3b70807c36b726de89880f02bf0088015ad62d9d6a8" exitCode=0
Jul 21 17:11:03.112404 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:03.112049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325663280" event={"ID":"b19971d3-1168-48be-84c1-e06b57a19431","Type":"ContainerDied","Data":"62150cf591f8f4eb4527c3b70807c36b726de89880f02bf0088015ad62d9d6a8"}
Jul 21 17:11:04.247645 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.247620    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:04.253190 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.253168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd97l\" (UniqueName: \"kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l\") pod \"b19971d3-1168-48be-84c1-e06b57a19431\" (UID: \"b19971d3-1168-48be-84c1-e06b57a19431\") "
Jul 21 17:11:04.255043 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.255022    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l" (OuterVolumeSpecName: "kube-api-access-qd97l") pod "b19971d3-1168-48be-84c1-e06b57a19431" (UID: "b19971d3-1168-48be-84c1-e06b57a19431"). InnerVolumeSpecName "kube-api-access-qd97l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:04.270786 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.270764    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325663280_b19971d3-1168-48be-84c1-e06b57a19431/test-curl-7791-139884325663280/0.log"
Jul 21 17:11:04.297823 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.297797    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325663280"]
Jul 21 17:11:04.301453 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.301432    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325663280"]
Jul 21 17:11:04.354449 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:04.354422    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd97l\" (UniqueName: \"kubernetes.io/projected/b19971d3-1168-48be-84c1-e06b57a19431-kube-api-access-qd97l\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:05.125038 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:05.125012    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d2fe936907266bd9b4220556879f5760873c07b468d891fb8ce58cab1158269"
Jul 21 17:11:05.125038 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:05.125013    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:05.135201 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:11:05.135171    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-139884325663280\" is forbidden: User \"system:node:ip-10-0-141-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-38.ec2.internal' and this object" podUID="b19971d3-1168-48be-84c1-e06b57a19431" pod="opendatahub/test-curl-7791-139884325663280"
Jul 21 17:11:06.108165 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:06.108114    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19971d3-1168-48be-84c1-e06b57a19431" path="/var/lib/kubelet/pods/b19971d3-1168-48be-84c1-e06b57a19431/volumes"
Jul 21 17:11:07.173183 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.173145    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:07.173578 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.173563    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19971d3-1168-48be-84c1-e06b57a19431" containerName="test-curl-7791-139884325663280"
Jul 21 17:11:07.173578 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.173577    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19971d3-1168-48be-84c1-e06b57a19431" containerName="test-curl-7791-139884325663280"
Jul 21 17:11:07.173666 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.173644    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b19971d3-1168-48be-84c1-e06b57a19431" containerName="test-curl-7791-139884325663280"
Jul 21 17:11:07.176880 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.176863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.179889 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.179865    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ntrxf\""
Jul 21 17:11:07.183853 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.183828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:07.281454 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.281419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7xm\" (UniqueName: \"kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm\") pod \"test-curl-7791-139884325676784\" (UID: \"e793296e-4aba-487e-9254-adce79a8b044\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.382612 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.382582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7xm\" (UniqueName: \"kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm\") pod \"test-curl-7791-139884325676784\" (UID: \"e793296e-4aba-487e-9254-adce79a8b044\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.392023 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.391996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7xm\" (UniqueName: \"kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm\") pod \"test-curl-7791-139884325676784\" (UID: \"e793296e-4aba-487e-9254-adce79a8b044\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.487675 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.487582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.616496 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:07.616471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:07.617616 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:11:07.617589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode793296e_4aba_487e_9254_adce79a8b044.slice/crio-2309d4065168a6bd8b78ce3c6883115c26321f6e16ad6e167759cd23846530c3 WatchSource:0}: Error finding container 2309d4065168a6bd8b78ce3c6883115c26321f6e16ad6e167759cd23846530c3: Status 404 returned error can't find the container with id 2309d4065168a6bd8b78ce3c6883115c26321f6e16ad6e167759cd23846530c3
Jul 21 17:11:08.143797 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:08.143763    2577 generic.go:356] "Generic (PLEG): container finished" podID="e793296e-4aba-487e-9254-adce79a8b044" containerID="03a36dc67cd304b61b570bd1f0e24a6f7a0312a7215b6e528bac95ab7edcc36f" exitCode=0
Jul 21 17:11:08.143984 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:08.143839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325676784" event={"ID":"e793296e-4aba-487e-9254-adce79a8b044","Type":"ContainerDied","Data":"03a36dc67cd304b61b570bd1f0e24a6f7a0312a7215b6e528bac95ab7edcc36f"}
Jul 21 17:11:08.143984 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:08.143879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325676784" event={"ID":"e793296e-4aba-487e-9254-adce79a8b044","Type":"ContainerStarted","Data":"2309d4065168a6bd8b78ce3c6883115c26321f6e16ad6e167759cd23846530c3"}
Jul 21 17:11:09.277953 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.277932    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:09.298579 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.298558    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325676784_e793296e-4aba-487e-9254-adce79a8b044/test-curl-7791-139884325676784/0.log"
Jul 21 17:11:09.299641 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.299622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw7xm\" (UniqueName: \"kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm\") pod \"e793296e-4aba-487e-9254-adce79a8b044\" (UID: \"e793296e-4aba-487e-9254-adce79a8b044\") "
Jul 21 17:11:09.301581 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.301553    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm" (OuterVolumeSpecName: "kube-api-access-dw7xm") pod "e793296e-4aba-487e-9254-adce79a8b044" (UID: "e793296e-4aba-487e-9254-adce79a8b044"). InnerVolumeSpecName "kube-api-access-dw7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:09.325442 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.325119    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:09.330626 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.330604    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:09.401096 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.401020    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw7xm\" (UniqueName: \"kubernetes.io/projected/e793296e-4aba-487e-9254-adce79a8b044-kube-api-access-dw7xm\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.460144 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.460102    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:09.460523 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.460509    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e793296e-4aba-487e-9254-adce79a8b044" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:09.460587 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.460525    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e793296e-4aba-487e-9254-adce79a8b044" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:09.460627 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.460591    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e793296e-4aba-487e-9254-adce79a8b044" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:09.463637 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.463621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:09.469932 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.469890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:09.502358 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.502333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gd89\" (UniqueName: \"kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89\") pod \"test-curl-7791-139884325677792\" (UID: \"76080894-5e23-4f3d-ac62-4147e4bbd634\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:09.602953 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.602922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gd89\" (UniqueName: \"kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89\") pod \"test-curl-7791-139884325677792\" (UID: \"76080894-5e23-4f3d-ac62-4147e4bbd634\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:09.611858 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.611835    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gd89\" (UniqueName: \"kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89\") pod \"test-curl-7791-139884325677792\" (UID: \"76080894-5e23-4f3d-ac62-4147e4bbd634\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:09.774198 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.774121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:09.903658 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:09.903634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:09.905094 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:11:09.905054    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76080894_5e23_4f3d_ac62_4147e4bbd634.slice/crio-c28825d6dea4e0697928cbb4b6bafde2953d85dcbd8f0f5bc8fc279b6cf233e3 WatchSource:0}: Error finding container c28825d6dea4e0697928cbb4b6bafde2953d85dcbd8f0f5bc8fc279b6cf233e3: Status 404 returned error can't find the container with id c28825d6dea4e0697928cbb4b6bafde2953d85dcbd8f0f5bc8fc279b6cf233e3
Jul 21 17:11:10.108647 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:10.108617    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e793296e-4aba-487e-9254-adce79a8b044" path="/var/lib/kubelet/pods/e793296e-4aba-487e-9254-adce79a8b044/volumes"
Jul 21 17:11:10.154950 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:10.154918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325677792" event={"ID":"76080894-5e23-4f3d-ac62-4147e4bbd634","Type":"ContainerStarted","Data":"c28825d6dea4e0697928cbb4b6bafde2953d85dcbd8f0f5bc8fc279b6cf233e3"}
Jul 21 17:11:10.156070 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:10.156049    2577 scope.go:117] "RemoveContainer" containerID="03a36dc67cd304b61b570bd1f0e24a6f7a0312a7215b6e528bac95ab7edcc36f"
Jul 21 17:11:10.156186 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:10.156052    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:11.162290 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:11.162253    2577 generic.go:356] "Generic (PLEG): container finished" podID="76080894-5e23-4f3d-ac62-4147e4bbd634" containerID="8377b106e334467c7aec692825f872dddb6c8fca8dc61b1caca29f44c481f1ce" exitCode=0
Jul 21 17:11:11.162723 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:11.162352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325677792" event={"ID":"76080894-5e23-4f3d-ac62-4147e4bbd634","Type":"ContainerDied","Data":"8377b106e334467c7aec692825f872dddb6c8fca8dc61b1caca29f44c481f1ce"}
Jul 21 17:11:12.296816 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.296793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.317280 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.317259    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325677792_76080894-5e23-4f3d-ac62-4147e4bbd634/test-curl-7791-139884325677792/0.log"
Jul 21 17:11:12.326458 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.326434    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gd89\" (UniqueName: \"kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89\") pod \"76080894-5e23-4f3d-ac62-4147e4bbd634\" (UID: \"76080894-5e23-4f3d-ac62-4147e4bbd634\") "
Jul 21 17:11:12.328490 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.328462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89" (OuterVolumeSpecName: "kube-api-access-2gd89") pod "76080894-5e23-4f3d-ac62-4147e4bbd634" (UID: "76080894-5e23-4f3d-ac62-4147e4bbd634"). InnerVolumeSpecName "kube-api-access-2gd89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:12.343088 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.343061    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:12.345445 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.345424    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:12.427932 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:12.427855    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gd89\" (UniqueName: \"kubernetes.io/projected/76080894-5e23-4f3d-ac62-4147e4bbd634-kube-api-access-2gd89\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:13.174202 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:13.174174    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c28825d6dea4e0697928cbb4b6bafde2953d85dcbd8f0f5bc8fc279b6cf233e3"
Jul 21 17:11:13.174396 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:13.174205    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:13.184492 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:11:13.184465    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-139884325677792\" is forbidden: User \"system:node:ip-10-0-141-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-38.ec2.internal' and this object" podUID="76080894-5e23-4f3d-ac62-4147e4bbd634" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:14.108216 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:14.108183    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76080894-5e23-4f3d-ac62-4147e4bbd634" path="/var/lib/kubelet/pods/76080894-5e23-4f3d-ac62-4147e4bbd634/volumes"
Jul 21 17:11:15.851190 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:15.851156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:15.951140 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:15.951110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:25.783106 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:25.783016    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:11:25.783698 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:25.783269    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerName="maas-api" containerID="cri-o://2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f" gracePeriod=30
Jul 21 17:11:25.806640 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:25.806615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:25.921217 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:25.921182    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.63:8443/health\": dial tcp 10.133.0.63:8443: connect: connection refused"
Jul 21 17:11:26.037515 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.037454    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:11:26.150557 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.150531    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls\") pod \"28eb833c-90af-48c5-b03b-55fce18f5fa2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") "
Jul 21 17:11:26.150720 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.150569    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4jjr\" (UniqueName: \"kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr\") pod \"28eb833c-90af-48c5-b03b-55fce18f5fa2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") "
Jul 21 17:11:26.150720 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.150622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca\") pod \"28eb833c-90af-48c5-b03b-55fce18f5fa2\" (UID: \"28eb833c-90af-48c5-b03b-55fce18f5fa2\") "
Jul 21 17:11:26.151106 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.151071    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28eb833c-90af-48c5-b03b-55fce18f5fa2" (UID: "28eb833c-90af-48c5-b03b-55fce18f5fa2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:26.152674 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.152654    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr" (OuterVolumeSpecName: "kube-api-access-l4jjr") pod "28eb833c-90af-48c5-b03b-55fce18f5fa2" (UID: "28eb833c-90af-48c5-b03b-55fce18f5fa2"). InnerVolumeSpecName "kube-api-access-l4jjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:26.152751 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.152732    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28eb833c-90af-48c5-b03b-55fce18f5fa2" (UID: "28eb833c-90af-48c5-b03b-55fce18f5fa2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:26.242414 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.242376    2577 generic.go:356] "Generic (PLEG): container finished" podID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerID="2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f" exitCode=0
Jul 21 17:11:26.242545 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.242426    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"
Jul 21 17:11:26.242545 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.242438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" event={"ID":"28eb833c-90af-48c5-b03b-55fce18f5fa2","Type":"ContainerDied","Data":"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"}
Jul 21 17:11:26.242545 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.242486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2" event={"ID":"28eb833c-90af-48c5-b03b-55fce18f5fa2","Type":"ContainerDied","Data":"cda414105bc2e2a4f6d3553cb45b4c67007a6660fd47b6b914ce4ae9613d3eaa"}
Jul 21 17:11:26.242545 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.242518    2577 scope.go:117] "RemoveContainer" containerID="2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"
Jul 21 17:11:26.251283 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.251264    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28eb833c-90af-48c5-b03b-55fce18f5fa2-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:26.251283 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.251284    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28eb833c-90af-48c5-b03b-55fce18f5fa2-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:26.251472 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.251297    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4jjr\" (UniqueName: \"kubernetes.io/projected/28eb833c-90af-48c5-b03b-55fce18f5fa2-kube-api-access-l4jjr\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:26.254283 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.254260    2577 scope.go:117] "RemoveContainer" containerID="2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"
Jul 21 17:11:26.254793 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:11:26.254770    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f\": container with ID starting with 2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f not found: ID does not exist" containerID="2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"
Jul 21 17:11:26.254887 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.254800    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f"} err="failed to get container status \"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f\": rpc error: code = NotFound desc = could not find container \"2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f\": container with ID starting with 2dcaa6f606f0de1f50ceaf001e0acfa44bad860a856999f765472b52b99d305f not found: ID does not exist"
Jul 21 17:11:26.265512 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.265490    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:11:26.270086 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:26.270058    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-07bb43-658c67c5f7-tvlj2"]
Jul 21 17:11:28.107238 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:28.107199    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" path="/var/lib/kubelet/pods/28eb833c-90af-48c5-b03b-55fce18f5fa2/volumes"
Jul 21 17:11:30.403881 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:30.403851    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:30.808907 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:30.808824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:36.926485 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:36.926434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:37.004903 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:37.004861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:37.198515 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:37.198424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:37.411263 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:37.411221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:38.083441 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:38.083407    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:38.183381 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:38.183345    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:47.976868 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:47.976834    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:11:47.977250 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:47.977075    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" podUID="80c3a416-1371-483f-8836-39a55d35507f" containerName="maas-api" containerID="cri-o://043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b" gracePeriod=30
Jul 21 17:11:48.004702 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.004633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:48.228143 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.228074    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:11:48.346056 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.346025    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rr55\" (UniqueName: \"kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55\") pod \"80c3a416-1371-483f-8836-39a55d35507f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") "
Jul 21 17:11:48.346211 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.346095    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls\") pod \"80c3a416-1371-483f-8836-39a55d35507f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") "
Jul 21 17:11:48.346211 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.346120    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca\") pod \"80c3a416-1371-483f-8836-39a55d35507f\" (UID: \"80c3a416-1371-483f-8836-39a55d35507f\") "
Jul 21 17:11:48.346577 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.346552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80c3a416-1371-483f-8836-39a55d35507f" (UID: "80c3a416-1371-483f-8836-39a55d35507f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:48.348199 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.348177    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80c3a416-1371-483f-8836-39a55d35507f" (UID: "80c3a416-1371-483f-8836-39a55d35507f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:48.348350 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.348298    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55" (OuterVolumeSpecName: "kube-api-access-6rr55") pod "80c3a416-1371-483f-8836-39a55d35507f" (UID: "80c3a416-1371-483f-8836-39a55d35507f"). InnerVolumeSpecName "kube-api-access-6rr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:48.366255 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.366227    2577 generic.go:356] "Generic (PLEG): container finished" podID="80c3a416-1371-483f-8836-39a55d35507f" containerID="043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b" exitCode=0
Jul 21 17:11:48.366398 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.366271    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"
Jul 21 17:11:48.366398 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.366322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" event={"ID":"80c3a416-1371-483f-8836-39a55d35507f","Type":"ContainerDied","Data":"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"}
Jul 21 17:11:48.366398 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.366373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f" event={"ID":"80c3a416-1371-483f-8836-39a55d35507f","Type":"ContainerDied","Data":"dd5257c029408b9e793886a9d5ea5c346528c3a599e95926284dc23c51589158"}
Jul 21 17:11:48.366398 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.366396    2577 scope.go:117] "RemoveContainer" containerID="043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"
Jul 21 17:11:48.375645 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.375625    2577 scope.go:117] "RemoveContainer" containerID="043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"
Jul 21 17:11:48.375898 ip-10-0-141-38 kubenswrapper[2577]: E0721 17:11:48.375880    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b\": container with ID starting with 043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b not found: ID does not exist" containerID="043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"
Jul 21 17:11:48.375959 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.375907    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b"} err="failed to get container status \"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b\": rpc error: code = NotFound desc = could not find container \"043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b\": container with ID starting with 043676aab5371abfbe3e41ebb5e7d6f23bbf2a61d47a1560d9a00108b5baa41b not found: ID does not exist"
Jul 21 17:11:48.389573 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.389551    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:11:48.395096 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.395075    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e5534-7cf755f997-lsw4f"]
Jul 21 17:11:48.447717 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.447684    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80c3a416-1371-483f-8836-39a55d35507f-maas-api-tls\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:48.447717 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.447708    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80c3a416-1371-483f-8836-39a55d35507f-openshift-service-ca\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:48.447717 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:48.447718    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rr55\" (UniqueName: \"kubernetes.io/projected/80c3a416-1371-483f-8836-39a55d35507f-kube-api-access-6rr55\") on node \"ip-10-0-141-38.ec2.internal\" DevicePath \"\""
Jul 21 17:11:50.107376 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:50.107346    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c3a416-1371-483f-8836-39a55d35507f" path="/var/lib/kubelet/pods/80c3a416-1371-483f-8836-39a55d35507f/volumes"
Jul 21 17:11:52.620788 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:52.620753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:53.012075 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:53.011983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:56.789884 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:56.789850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:56.895032 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:56.894989    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:58.970523 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:58.970472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:59.037097 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:59.037062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:59.239902 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:59.239807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:59.623514 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:59.623480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:11:59.864463 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:11:59.864430    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66cb946847-wqdw2_e119d500-4da3-42ed-a1f3-1f3cc0b76687/authorino/0.log"
Jul 21 17:12:05.294148 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:05.294111    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5486b4fd5-2wj9n_1cee787f-850f-46af-a088-d1116ac2524b/manager/0.log"
Jul 21 17:12:05.545394 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:05.545322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mxqpw_2d8b8ac1-b90d-4e00-9761-1b71d53064b4/manager/0.log"
Jul 21 17:12:05.659932 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:05.659907    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-2jcxw_b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2/copy-manifests/0.log"
Jul 21 17:12:05.667677 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:05.667656    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-2jcxw_b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2/manager/0.log"
Jul 21 17:12:06.271812 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:06.271787    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b9ff9cd55-tct8n_0f0f2dad-8724-4f43-bb95-fd1ae0e808a3/maas-api/0.log"
Jul 21 17:12:06.604129 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:06.604044    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mfzhb_053322ce-aa7d-4452-b5f2-f84f49f66867/postgres/0.log"
Jul 21 17:12:07.372184 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.372157    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/util/0.log"
Jul 21 17:12:07.379200 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.379175    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/pull/0.log"
Jul 21 17:12:07.385889 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.385873    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/extract/0.log"
Jul 21 17:12:07.503056 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.503011    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/util/0.log"
Jul 21 17:12:07.509815 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.509791    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/pull/0.log"
Jul 21 17:12:07.515880 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.515860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/extract/0.log"
Jul 21 17:12:07.619828 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.619804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/util/0.log"
Jul 21 17:12:07.626022 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.625959    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/pull/0.log"
Jul 21 17:12:07.631733 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.631714    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/extract/0.log"
Jul 21 17:12:07.741388 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.741341    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/pull/0.log"
Jul 21 17:12:07.747803 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.747769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/extract/0.log"
Jul 21 17:12:07.753748 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.753730    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/util/0.log"
Jul 21 17:12:07.865526 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.865495    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66cb946847-wqdw2_e119d500-4da3-42ed-a1f3-1f3cc0b76687/authorino/0.log"
Jul 21 17:12:07.987183 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:07.987092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lqx97_549832a5-fe7a-40f2-bf05-fa08e46f19d2/manager/0.log"
Jul 21 17:12:08.327105 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:08.327013    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g5n6v_f796d933-443c-4a4d-a90b-a25617f1e9c3/registry-server/0.log"
Jul 21 17:12:08.443109 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:08.443066    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5vndl_8ceba58e-3912-40ca-b10f-26790e6651c3/manager/0.log"
Jul 21 17:12:09.022564 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:09.022534    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46gcwv_0a757c50-2703-44d5-8e37-8163b50ac236/istio-proxy/0.log"
Jul 21 17:12:09.486912 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:09.486880    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/1.log"
Jul 21 17:12:09.598868 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:09.598839    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vls22_697a4d54-3dc7-4529-9513-ab92f02ce46b/payload-pre-processing/0.log"
Jul 21 17:12:10.166215 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:10.166185    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-q896j_36a36661-8b19-493e-80af-eb07f033a479/main/0.log"
Jul 21 17:12:15.781513 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:15.781477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:15.868954 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:15.868920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:18.681540 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:18.681513    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-55rwx_f49d953a-8e68-41d4-90bc-dcb7b1e2e778/global-pull-secret-syncer/0.log"
Jul 21 17:12:18.816457 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:18.816428    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log"
Jul 21 17:12:18.936228 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:18.936154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-38.ec2.internal_18f3f30739cf6a3536e0906fc42f6c19/haproxy/0.log"
Jul 21 17:12:23.786715 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.786681    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/extract/0.log"
Jul 21 17:12:23.814023 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.813993    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/util/0.log"
Jul 21 17:12:23.846453 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.846427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wx77p_fe7610e1-d763-4b6d-9a1c-a042c8163037/pull/0.log"
Jul 21 17:12:23.881901 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.881881    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/extract/0.log"
Jul 21 17:12:23.917710 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.917682    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/util/0.log"
Jul 21 17:12:23.942006 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.941977    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hd9rg_2c3b0013-20fb-47d3-a1e5-9b109b6ddc63/pull/0.log"
Jul 21 17:12:23.974993 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:23.974966    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/extract/0.log"
Jul 21 17:12:24.012351 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.012303    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/util/0.log"
Jul 21 17:12:24.036353 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.036270    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73w7hqm_edb63530-ffe6-4d4d-a9ca-99d23752e458/pull/0.log"
Jul 21 17:12:24.077950 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.077875    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/extract/0.log"
Jul 21 17:12:24.097959 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.097934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/util/0.log"
Jul 21 17:12:24.126166 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.126137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t675z_8d076b3b-2a0e-48a1-8dbb-c9969ad2a385/pull/0.log"
Jul 21 17:12:24.475250 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.475216    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66cb946847-wqdw2_e119d500-4da3-42ed-a1f3-1f3cc0b76687/authorino/0.log"
Jul 21 17:12:24.501838 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.501812    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lqx97_549832a5-fe7a-40f2-bf05-fa08e46f19d2/manager/0.log"
Jul 21 17:12:24.603609 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.603578    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g5n6v_f796d933-443c-4a4d-a90b-a25617f1e9c3/registry-server/0.log"
Jul 21 17:12:24.785358 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:24.785246    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5vndl_8ceba58e-3912-40ca-b10f-26790e6651c3/manager/0.log"
Jul 21 17:12:27.033591 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.033557    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hm4cz_8681fcc4-650f-48ab-8317-22f27f7694b4/monitoring-plugin/0.log"
Jul 21 17:12:27.068829 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.068802    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfdk2_20403ff5-1e11-4c9e-bbdf-f41fb6e8343d/node-exporter/0.log"
Jul 21 17:12:27.092126 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.092096    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfdk2_20403ff5-1e11-4c9e-bbdf-f41fb6e8343d/kube-rbac-proxy/0.log"
Jul 21 17:12:27.115331 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.115294    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfdk2_20403ff5-1e11-4c9e-bbdf-f41fb6e8343d/init-textfile/0.log"
Jul 21 17:12:27.304355 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.304252    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4q2dn_f68bf870-7c6c-4a1d-88f4-4191ea774272/kube-rbac-proxy-main/0.log"
Jul 21 17:12:27.330953 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.330925    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4q2dn_f68bf870-7c6c-4a1d-88f4-4191ea774272/kube-rbac-proxy-self/0.log"
Jul 21 17:12:27.364018 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.363990    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4q2dn_f68bf870-7c6c-4a1d-88f4-4191ea774272/openshift-state-metrics/0.log"
Jul 21 17:12:27.676354 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.676296    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9747f688-hkvz8_21dd030d-c0dd-4acc-b660-c38c31cbee87/telemeter-client/0.log"
Jul 21 17:12:27.712264 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.712231    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9747f688-hkvz8_21dd030d-c0dd-4acc-b660-c38c31cbee87/reload/0.log"
Jul 21 17:12:27.749164 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:27.749135    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9747f688-hkvz8_21dd030d-c0dd-4acc-b660-c38c31cbee87/kube-rbac-proxy/0.log"
Jul 21 17:12:28.616756 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.616721    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"]
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617091    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerName="maas-api"
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617103    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerName="maas-api"
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617111    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76080894-5e23-4f3d-ac62-4147e4bbd634" containerName="test-curl-7791-139884325677792"
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617118    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="76080894-5e23-4f3d-ac62-4147e4bbd634" containerName="test-curl-7791-139884325677792"
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c3a416-1371-483f-8836-39a55d35507f" containerName="maas-api"
Jul 21 17:12:28.617176 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617135    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c3a416-1371-483f-8836-39a55d35507f" containerName="maas-api"
Jul 21 17:12:28.617406 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617186    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="76080894-5e23-4f3d-ac62-4147e4bbd634" containerName="test-curl-7791-139884325677792"
Jul 21 17:12:28.617406 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617195    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="28eb833c-90af-48c5-b03b-55fce18f5fa2" containerName="maas-api"
Jul 21 17:12:28.617406 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.617204    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c3a416-1371-483f-8836-39a55d35507f" containerName="maas-api"
Jul 21 17:12:28.619473 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.619453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.622259 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.622242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qc9mq\"/\"kube-root-ca.crt\""
Jul 21 17:12:28.623459 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.623437    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qc9mq\"/\"openshift-service-ca.crt\""
Jul 21 17:12:28.623566 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.623468    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qc9mq\"/\"default-dockercfg-652bc\""
Jul 21 17:12:28.630530 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.630509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"]
Jul 21 17:12:28.798828 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.798795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-proc\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.799007 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.798857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-podres\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.799007 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.798914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmp7\" (UniqueName: \"kubernetes.io/projected/90ed0d36-d85d-4438-aafc-355782ef21b0-kube-api-access-lnmp7\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.799007 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.798983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-lib-modules\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.799113 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.799053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-sys\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900014 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.899924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-sys\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900014 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.899983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-proc\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-podres\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-sys\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmp7\" (UniqueName: \"kubernetes.io/projected/90ed0d36-d85d-4438-aafc-355782ef21b0-kube-api-access-lnmp7\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-lib-modules\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-proc\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900226 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-podres\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.900464 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.900272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ed0d36-d85d-4438-aafc-355782ef21b0-lib-modules\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.909545 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.909524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmp7\" (UniqueName: \"kubernetes.io/projected/90ed0d36-d85d-4438-aafc-355782ef21b0-kube-api-access-lnmp7\") pod \"perf-node-gather-daemonset-p7v96\" (UID: \"90ed0d36-d85d-4438-aafc-355782ef21b0\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:28.929761 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:28.929740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:29.088700 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:29.088673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"]
Jul 21 17:12:29.090667 ip-10-0-141-38 kubenswrapper[2577]: W0721 17:12:29.090637    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod90ed0d36_d85d_4438_aafc_355782ef21b0.slice/crio-0cabfdea2f073120fe2bbd3d73aee8a923d7d9668dab0356e1d39a96d2814cdd WatchSource:0}: Error finding container 0cabfdea2f073120fe2bbd3d73aee8a923d7d9668dab0356e1d39a96d2814cdd: Status 404 returned error can't find the container with id 0cabfdea2f073120fe2bbd3d73aee8a923d7d9668dab0356e1d39a96d2814cdd
Jul 21 17:12:29.595092 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:29.595003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96" event={"ID":"90ed0d36-d85d-4438-aafc-355782ef21b0","Type":"ContainerStarted","Data":"fbe369648adbbdac4529de7e5a39600d5807f03548176facb9cad81d25002a49"}
Jul 21 17:12:29.595092 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:29.595056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96" event={"ID":"90ed0d36-d85d-4438-aafc-355782ef21b0","Type":"ContainerStarted","Data":"0cabfdea2f073120fe2bbd3d73aee8a923d7d9668dab0356e1d39a96d2814cdd"}
Jul 21 17:12:29.595281 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:29.595112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:29.613110 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:29.613063    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96" podStartSLOduration=1.613047746 podStartE2EDuration="1.613047746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:29.612283632 +0000 UTC m=+2850.064838845" watchObservedRunningTime="2026-07-21 17:12:29.613047746 +0000 UTC m=+2850.065602990"
Jul 21 17:12:30.192889 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:30.192860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7db8fb776-wklfc_0da5dfa7-a870-4696-91c4-ea1113c08ab1/console/0.log"
Jul 21 17:12:31.859683 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:31.859654    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n7m7_36259e17-91b0-4fd1-b01a-bc5e0b2efe99/dns/0.log"
Jul 21 17:12:31.881908 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:31.881865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n7m7_36259e17-91b0-4fd1-b01a-bc5e0b2efe99/kube-rbac-proxy/0.log"
Jul 21 17:12:32.008220 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:32.008192    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgxkf_4c11abb4-f1f3-4926-ae0d-b7ea4c165a16/dns-node-resolver/0.log"
Jul 21 17:12:32.681240 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:32.681212    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2zlh_fa366ece-178c-4273-a045-f47466118b38/node-ca/0.log"
Jul 21 17:12:33.597643 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:33.597611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46gcwv_0a757c50-2703-44d5-8e37-8163b50ac236/istio-proxy/0.log"
Jul 21 17:12:33.801901 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:33.801861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/0.log"
Jul 21 17:12:33.825802 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:33.825773    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/1.log"
Jul 21 17:12:33.856878 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:33.856849    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vls22_697a4d54-3dc7-4529-9513-ab92f02ce46b/payload-pre-processing/0.log"
Jul 21 17:12:34.014385 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:34.014352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:34.170135 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:34.170026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjw5r_22778f0b-691f-44c3-aed6-a3718c617ea9/konnectivity-agent/0.log" limit=1024
Jul 21 17:12:34.604718 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:34.604644    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8p9zm_2101ea20-cb8e-45dc-8552-113f1a586200/serve-healthcheck-canary/0.log"
Jul 21 17:12:35.186252 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:35.186224    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jsxs2_0e689d56-e7a2-4563-9968-e8d65f018382/kube-rbac-proxy/0.log"
Jul 21 17:12:35.208046 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:35.208023    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jsxs2_0e689d56-e7a2-4563-9968-e8d65f018382/exporter/0.log"
Jul 21 17:12:35.231046 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:35.231027    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jsxs2_0e689d56-e7a2-4563-9968-e8d65f018382/extractor/0.log"
Jul 21 17:12:35.610136 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:35.610107    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-p7v96"
Jul 21 17:12:38.132045 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:38.132015    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5486b4fd5-2wj9n_1cee787f-850f-46af-a088-d1116ac2524b/manager/0.log"
Jul 21 17:12:38.231105 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:38.231059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mxqpw_2d8b8ac1-b90d-4e00-9761-1b71d53064b4/manager/0.log"
Jul 21 17:12:38.259591 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:38.259505    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-2jcxw_b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2/manager/0.log"
Jul 21 17:12:38.282503 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:38.282475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-2jcxw_b58f88a8-4b5a-4bdc-a3a1-92bcdad2c5c2/copy-manifests/0.log"
Jul 21 17:12:39.062045 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.061962    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46gcwv_0a757c50-2703-44d5-8e37-8163b50ac236/istio-proxy/0.log"
Jul 21 17:12:39.248944 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.248914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/0.log"
Jul 21 17:12:39.272649 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.272619    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/1.log"
Jul 21 17:12:39.297163 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.297136    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vls22_697a4d54-3dc7-4529-9513-ab92f02ce46b/payload-pre-processing/0.log"
Jul 21 17:12:39.702815 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.702777    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76fbb8f576-ktsb4_f16d14b3-6ced-4494-a7ac-86940341667e/manager/0.log"
Jul 21 17:12:39.764797 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:39.764768    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wtvvd_a6272888-ee5e-4832-8b7c-c5ec75e3a6d3/openshift-lws-operator/0.log"
Jul 21 17:12:40.600132 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:40.600038    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46gcwv_0a757c50-2703-44d5-8e37-8163b50ac236/istio-proxy/0.log"
Jul 21 17:12:40.769558 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:40.769532    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/0.log"
Jul 21 17:12:40.795154 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:40.795126    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j78tl_408c8246-0a04-4319-a619-f9884e4e1f88/istio-proxy/1.log"
Jul 21 17:12:40.814997 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:40.814969    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-vls22_697a4d54-3dc7-4529-9513-ab92f02ce46b/payload-pre-processing/0.log"
Jul 21 17:12:44.849637 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:44.849611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-rnsgl_ca75bd3f-791b-412e-825a-07e9fbf1f8fa/migrator/0.log"
Jul 21 17:12:44.873055 ip-10-0-141-38 kubenswrapper[2577]: I0721 17:12:44.873030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-rnsgl_ca75bd3f-791b-412e-825a-07e9fbf1f8fa/graceful-termination/0.log"