Jul 07 19:07:01.016121 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 19:07:01.016133 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 19:07:01.016142 ip-10-0-141-105 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 19:07:01.016420 ip-10-0-141-105 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 19:07:11.038333 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 19:07:11.038353 ip-10-0-141-105 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 311c2b4c897b4eff835c0c7f2f1a77c0 --
Jul 07 19:09:15.465378 ip-10-0-141-105 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 19:09:15.896634 ip-10-0-141-105 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:09:15.896634 ip-10-0-141-105 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 19:09:15.896634 ip-10-0-141-105 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:09:15.896634 ip-10-0-141-105 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 19:09:15.896634 ip-10-0-141-105 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 19:09:15.897482 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.897424    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906194    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906210    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906214    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906217    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906220    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.906215 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906222    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906225    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906228    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906231    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906233    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906236    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906238    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906241    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906243    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906246    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906249    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906251    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906254    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906256    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906259    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906261    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906264    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906267    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906269    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906271    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.906409 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906277    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906280    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906283    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906285    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906288    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906290    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906293    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906295    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906298    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906300    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906302    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906305    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906307    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906310    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906313    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906316    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906318    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906321    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906324    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.906891 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906328    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906331    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906333    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906336    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906338    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906341    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906343    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906346    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906348    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906351    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906353    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906356    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906358    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906361    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906363    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906366    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906368    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906371    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906374    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906376    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.907393 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906379    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906382    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906384    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906386    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906389    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906391    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906394    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906398    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906402    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906405    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906407    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906410    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906412    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906415    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906419    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906423    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906426    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906429    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906433    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.907852 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906436    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906439    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906442    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906444    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906447    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906450    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906452    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906455    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906457    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906460    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906462    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906464    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906467    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906469    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906472    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.906474    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907211    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907219    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907222    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907225    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.908316 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907228    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907231    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907246    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907248    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907251    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907253    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907256    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907259    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907261    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907263    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907266    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907268    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907271    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907273    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907276    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907278    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907281    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907283    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907286    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907288    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.908813 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907291    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907293    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907295    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907298    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907300    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907302    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907305    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907309    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907312    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907315    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907317    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907320    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907323    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907327    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907330    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907333    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907336    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907339    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907342    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.909313 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907344    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907347    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907349    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907352    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907354    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907357    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907359    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907362    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907364    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907367    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907369    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907371    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907374    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907376    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907378    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907381    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907383    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907386    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907388    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.909758 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907390    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907392    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907396    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907398    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907402    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907405    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907408    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907410    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907413    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907415    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907417    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907420    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907422    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907424    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907427    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907429    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907432    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907434    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907438    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.910251 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907441    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907444    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907448    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907450    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907453    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907455    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907458    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907460    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907463    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907465    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907467    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907470    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907472    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907474    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907477    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907480    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907482    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907484    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907812    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907816    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.910703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907819    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907822    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907824    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907827    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907829    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907832    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907835    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907839    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907842    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907846    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907848    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907851    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907854    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907856    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907860    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907863    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907865    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907868    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907871    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.911204 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907874    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907876    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907879    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907881    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907884    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907887    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907889    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907891    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907894    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907896    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907899    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907902    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907904    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907906    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907909    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907911    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907914    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907916    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907919    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907921    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.911667 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907923    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907926    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907928    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907931    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907933    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907936    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907938    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907940    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907943    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907946    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907949    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907952    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907954    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907957    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907959    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907961    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907964    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907966    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907969    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907971    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.912150 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907973    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907976    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907978    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907980    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907983    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907985    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907987    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907989    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907992    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907994    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.907996    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908000    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908003    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908005    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908012    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908015    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908017    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908019    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908022    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.912618 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908024    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908026    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908030    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908033    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908037    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908040    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908042    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908045    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908048    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908050    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908052    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908055    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908057    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908059    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908062    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908064    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908066    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908068    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908071    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908151    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908166    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 19:09:15.913057 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908172    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908176    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908180    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908183    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908187    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908191    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908194    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908196    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908200    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908203    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908206    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908208    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908213    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908216    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908219    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908222    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908225    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908228    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908231    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908234    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908237    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908240    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908243    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 19:09:15.913601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908246    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908249    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908252    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908254    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908257    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908260    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908263    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908266    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908269    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908273    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908276    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908279    2570 flags.go:64] FLAG: --enable-server="true"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908281    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908285    2570 flags.go:64] FLAG: --event-burst="100"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908288    2570 flags.go:64] FLAG: --event-qps="50"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908291    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908293    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908296    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908299    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908302    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908305    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908309    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908312    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908314    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908318    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 19:09:15.914190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908320    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908323    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908326    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908329    2570 flags.go:64] FLAG: --feature-gates=""
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908332    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908335    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908338    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908341    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908344    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908346    2570 flags.go:64] FLAG: --help="false"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908349    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-141-105.ec2.internal"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908352    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908354    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908357    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908360    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908363    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908367    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908369    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908372    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908375    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908377    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908380    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908383    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908385    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 19:09:15.914805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908387    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908390    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908393    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908395    2570 flags.go:64] FLAG: --lock-file=""
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908399    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908402    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908405    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908410    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908413    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908415    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908418    2570 flags.go:64] FLAG: --logging-format="text"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908420    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908423    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908426    2570 flags.go:64] FLAG: --manifest-url=""
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908429    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908432    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908435    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908439    2570 flags.go:64] FLAG: --max-pods="110"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908441    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908444    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908447    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908449    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908452    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908455    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908458    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 19:09:15.915410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908465    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908468    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908470    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908473    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908476    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908481    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908484    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908486    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908489    2570 flags.go:64] FLAG: --port="10250"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908492    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908495    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a750f13c292c2b64"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908498    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908502    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908504    2570 flags.go:64] FLAG: --register-node="true"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908507    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908511    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908514    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908516    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908519    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908522    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908525    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908528    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908530    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908533    2570 flags.go:64] FLAG: --runonce="false"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908535    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 19:09:15.916006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908538    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908541    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908543    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908546    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908548    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908551    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908555    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908558    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908560    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908563    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908565    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908568    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908571    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908573    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908578    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908580    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908583    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908586    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908589    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908592    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908595    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908598    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908601    2570 flags.go:64] FLAG: --v="2"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908604    2570 flags.go:64] FLAG: --version="false"
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908608    2570 flags.go:64] FLAG: --vmodule=""
Jul 07 19:09:15.916602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908612    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.908614    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908741    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908744    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908747    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908749    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908752    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908755    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908757    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908760    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908762    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908765    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908767    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908771    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908773    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908776    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908778    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908781    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908783    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908786    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908788    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.917230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908790    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908793    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908795    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908798    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908800    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908804    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908806    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908809    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908811    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908813    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908816    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908824    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908827    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908829    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908832    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908834    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908837    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908839    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908843    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.917719 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908846    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908849    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908852    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908854    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908857    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908860    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908862    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908865    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908867    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908869    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908872    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908874    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908876    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908879    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908881    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908883    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908886    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908888    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908893    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908896    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.918261 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908899    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908901    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908904    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908906    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908908    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908916    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908919    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908921    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908924    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908926    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908929    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908931    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908933    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908936    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908938    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908940    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908943    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908946    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908948    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.918751 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908951    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908953    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908955    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908958    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908960    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908962    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908965    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908967    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908969    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908971    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908974    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908977    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908980    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908988    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908990    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908993    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908995    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.908997    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.909000    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.909009    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.919312 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.909012    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.909015    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.909021    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.914919    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.914933    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.914945    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.914950    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915015    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915021    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915024    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915027    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915031    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915035    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915038    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.919786 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915041    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915043    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915046    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915048    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915051    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915053    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915056    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915058    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915061    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915064    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915066    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915068    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915071    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915073    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915076    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915078    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915081    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915100    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915103    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915106    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.920147 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915108    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915111    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915115    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915117    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915120    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915122    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915125    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915127    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915130    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915132    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915135    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915137    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915139    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915142    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915146    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915150    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915152    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915154    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915157    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.920716 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915160    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915162    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915165    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915167    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915169    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915173    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915177    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915179    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915182    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915185    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915187    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915190    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915193    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915196    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915198    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915202    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915205    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915208    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915211    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.921231 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915213    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915216    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915218    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915220    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915223    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915225    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915228    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915243    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915246    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915249    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915251    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915253    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915255    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915258    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915260    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915262    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915264    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915267    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915269    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915272    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.921708 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915274    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915276    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915278    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915281    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915284    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915286    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915288    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915291    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915293    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915296    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915299    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915302    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915304    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915306    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.915311    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:09:15.922392 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915413    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915418    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915421    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915424    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915427    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915429    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915432    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915435    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915438    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915440    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915443    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915445    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915448    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915451    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915453    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915456    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915458    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915460    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915463    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915465    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 19:09:15.922999 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915468    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915470    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915473    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915475    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915478    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915480    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915483    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915485    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915488    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915490    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915493    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915495    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915497    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915500    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915502    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915504    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915507    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915509    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915511    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915513    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 19:09:15.923811 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915516    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915518    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915520    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915523    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915525    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915527    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915530    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915532    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915534    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915536    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915539    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915541    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915543    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915546    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915548    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915550    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915553    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915555    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915557    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915560    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 19:09:15.924451 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915562    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915565    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915567    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915569    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915573    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915576    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915579    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915582    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915584    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915587    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915589    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915592    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915594    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915598    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915601    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915604    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915606    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915609    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 19:09:15.924918 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915611    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915614    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915616    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915618    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915621    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915623    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915625    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915628    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915630    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915633    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915635    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915637    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915641    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915644    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915646    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915649    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915651    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915654    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915656    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915658    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 19:09:15.925501 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:15.915661    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.915666    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.915762    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.917953    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.920120    2570 server.go:1019] "Starting client certificate rotation"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.920241    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.920291    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.922508    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 19:09:15.925982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.925248    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 19:09:15.939143 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.939123    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 07 19:09:15.941429 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.941414    2570 log.go:25] "Validated CRI v1 image API"
Jul 07 19:09:15.942246 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.942231    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 19:09:15.945259 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.945241    2570 fs.go:135] Filesystem UUIDs: map[0e1ca6fb-73a8-4146-98f1-1da1d7815563:/dev/nvme0n1p3 21cd761b-f97a-4c3b-8a6a-237b48ecf960:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 07 19:09:15.945311 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.945258    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 19:09:15.950554 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.950452    2570 manager.go:216] Machine: {Timestamp:2026-07-07 19:09:15.9489062 +0000 UTC m=+0.357389747 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3206952 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a7dcda8f74b336ddd717c0095aed SystemUUID:ec28a7dc-da8f-74b3-36dd-d717c0095aed BootID:311c2b4c-897b-4eff-835c-0c7f2f1a77c0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:6b:0e:59:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:6b:0e:59:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:53:1f:d5:72:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 19:09:15.950554 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.950550    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 19:09:15.950656 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.950613    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 19:09:15.953691 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.953677    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 19:09:15.954148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.954111    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 19:09:15.954281 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.954153    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 19:09:15.954904 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.954896    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 19:09:15.954936 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.954908    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 19:09:15.954936 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.954915    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 19:09:15.955611 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.955599    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 19:09:15.956954 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.956944    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 19:09:15.960433 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960422    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 19:09:15.960661 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960651    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 19:09:15.960692 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960685    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 19:09:15.960725 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960708    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 19:09:15.960751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960725    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 19:09:15.960751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960738    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 07 19:09:15.960751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.960747    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 19:09:15.961147 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.961133    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 19:09:15.961201 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.961161    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 19:09:15.963546 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.963529    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 19:09:15.965539 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.965524    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 19:09:15.965578 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.965559    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 19:09:15.966949 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966936    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 19:09:15.966989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966958    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 19:09:15.966989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966968    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 19:09:15.966989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966975    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 19:09:15.966989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966983    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 19:09:15.966989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966988    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.966995    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967000    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967013    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967028    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967046    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 19:09:15.967140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967052    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 19:09:15.967927 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967917    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 19:09:15.967955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.967929    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 19:09:15.970564 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.970535    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 19:09:15.970651 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.970600    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 19:09:15.970793 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.970762    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 19:09:15.971912 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.971895    2570 server.go:1268] "Started kubelet"
Jul 07 19:09:15.972028 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.971944    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 19:09:15.972133 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.971970    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 19:09:15.972290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.972272    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 19:09:15.972677 ip-10-0-141-105 systemd[1]: Started Kubernetes Kubelet.
Jul 07 19:09:15.973962 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.973947    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 19:09:15.974289 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.974275    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 19:09:15.977465 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.977449    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 19:09:15.978069 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.977164    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18c0178f22e39e73  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-07-07 19:09:15.971821171 +0000 UTC m=+0.380304724,LastTimestamp:2026-07-07 19:09:15.971821171 +0000 UTC m=+0.380304724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}"
Jul 07 19:09:15.980268 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980254    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 19:09:15.980339 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980271    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 19:09:15.980339 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.980323    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:15.980900 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980881    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 19:09:15.980900 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980908    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 19:09:15.980900 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980924    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 19:09:15.981252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980957    2570 factory.go:55] Registering systemd factory
Jul 07 19:09:15.981252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.980969    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 07 19:09:15.981252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981100    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 19:09:15.981252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981111    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 19:09:15.981252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981245    2570 factory.go:153] Registering CRI-O factory
Jul 07 19:09:15.981469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981258    2570 factory.go:223] Registration of the crio container factory successfully
Jul 07 19:09:15.981469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981330    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 19:09:15.981469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981347    2570 factory.go:103] Registering Raw factory
Jul 07 19:09:15.981469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981357    2570 manager.go:1196] Started watching for new ooms in manager
Jul 07 19:09:15.981846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.981833    2570 manager.go:349] Starting recovery of all containers
Jul 07 19:09:15.985938 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.985794    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4q4vf"
Jul 07 19:09:15.989584 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.989484    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 19:09:15.989584 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:15.989514    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 19:09:15.993182 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.993154    2570 manager.go:354] Recovery completed
Jul 07 19:09:15.993518 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.993502    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4q4vf"
Jul 07 19:09:15.998744 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:15.998731    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.000663 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.000647    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.000748 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.000680    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.000748 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.000695    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.001261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001247    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 19:09:16.001261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001260    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 19:09:16.001386 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001278    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 19:09:16.001386 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001288    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.001970 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001955    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.002017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.001988    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.002017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.002000    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.002540 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.002527    2570 policy_none.go:49] "None policy: Start"
Jul 07 19:09:16.002595 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.002546    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 19:09:16.002595 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.002559    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 19:09:16.003292 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.003217    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18c0178f249bb63f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-07-07 19:09:16.000663103 +0000 UTC m=+0.409146669,LastTimestamp:2026-07-07 19:09:16.000663103 +0000 UTC m=+0.409146669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}"
Jul 07 19:09:16.003621 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.003609    2570 policy_none.go:47] "Start"
Jul 07 19:09:16.054698 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.054684    2570 manager.go:337] "Starting Device Plugin manager"
Jul 07 19:09:16.054762 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.054713    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 19:09:16.054762 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.054724    2570 server.go:87] "Starting device plugin registration server"
Jul 07 19:09:16.054964 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.054952    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 19:09:16.055020 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.054966    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 19:09:16.055150 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.055078    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 19:09:16.055210 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.055179    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 19:09:16.055210 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.055189    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 19:09:16.055636 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.055615    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 19:09:16.055697 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.055666    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.155519 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.155469    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.156559 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.156360    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.156559 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.156389    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.156559 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.156404    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.156559 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.156434    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.167167 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.167154    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.167215 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.167173    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-105.ec2.internal\": node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.169031 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.169006    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 19:09:16.170254 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.170237    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 19:09:16.170336 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.170269    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 19:09:16.170336 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.170303    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 19:09:16.170425 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.170334    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 19:09:16.172663 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.172649    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:16.246070 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.246044    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.271131 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.271112    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"]
Jul 07 19:09:16.271191 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.271170    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.272007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.271988    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.272104 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.272017    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.272104 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.272027    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.273589 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.273577    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.273689 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.273677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.273719 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.273709    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.274315 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274301    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.274393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274317    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.274393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274325    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.274393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274335    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.274393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274339    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.274393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.274345    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.275534 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.275514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.275590 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.275538    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 19:09:16.276132 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.276115    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 19:09:16.276215 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.276146    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 19:09:16.276215 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.276159    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID"
Jul 07 19:09:16.282261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.282245    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.282338 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.282274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.282338 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.282302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b912bebfdf89ae599c4f63a8166d7eb-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"2b912bebfdf89ae599c4f63a8166d7eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.310631 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.310611    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.314879 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.314865    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.346462 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.346443    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.383050 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.383142 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.383142 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383076    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b912bebfdf89ae599c4f63a8166d7eb-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"2b912bebfdf89ae599c4f63a8166d7eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.383142 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383138    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.383237 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383145    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b912bebfdf89ae599c4f63a8166d7eb-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"2b912bebfdf89ae599c4f63a8166d7eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.383237 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.383168    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92b52cfa3a8376fe46556810ba765b26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"92b52cfa3a8376fe46556810ba765b26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.447305 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.447262    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.547966 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.547936    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.613356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.613334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.618290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.618275    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:16.648509 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.648488    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.749069 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.749017    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.849452 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.849433    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.899898 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.899877    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:16.919122 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.919103    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 19:09:16.919253 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.919206    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 19:09:16.919287 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.919259    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 19:09:16.950400 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:16.950375    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found"
Jul 07 19:09:16.996094 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.996067    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 19:04:16 +0000 UTC" deadline="2028-02-03 09:48:07.797514058 +0000 UTC"
Jul 07 19:09:16.996171 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:16.996102    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13814h38m50.801415031s"
Jul 07 19:09:17.004104 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.004044    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:17.036707 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.036682    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:17.081439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.081416    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:17.094868 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.094851    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 19:09:17.095844 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.095829    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"
Jul 07 19:09:17.107128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.107112    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 19:09:17.141246 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:17.141213    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b52cfa3a8376fe46556810ba765b26.slice/crio-ff135fa0c2e37be72d8f475ee2da9ae13aff955b77a07977287b296352e36186 WatchSource:0}: Error finding container ff135fa0c2e37be72d8f475ee2da9ae13aff955b77a07977287b296352e36186: Status 404 returned error can't find the container with id ff135fa0c2e37be72d8f475ee2da9ae13aff955b77a07977287b296352e36186
Jul 07 19:09:17.141703 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:17.141685    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b912bebfdf89ae599c4f63a8166d7eb.slice/crio-591677c552be2a3a102c1496462e3ce6f541a0b9b5eadbd5a2e0d0a3a6e86604 WatchSource:0}: Error finding container 591677c552be2a3a102c1496462e3ce6f541a0b9b5eadbd5a2e0d0a3a6e86604: Status 404 returned error can't find the container with id 591677c552be2a3a102c1496462e3ce6f541a0b9b5eadbd5a2e0d0a3a6e86604
Jul 07 19:09:17.147159 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.147141    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:09:17.174582 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.174529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"2b912bebfdf89ae599c4f63a8166d7eb","Type":"ContainerStarted","Data":"591677c552be2a3a102c1496462e3ce6f541a0b9b5eadbd5a2e0d0a3a6e86604"}
Jul 07 19:09:17.175662 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.175642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"92b52cfa3a8376fe46556810ba765b26","Type":"ContainerStarted","Data":"ff135fa0c2e37be72d8f475ee2da9ae13aff955b77a07977287b296352e36186"}
Jul 07 19:09:17.825953 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.825920    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:17.962626 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.962354    2570 apiserver.go:52] "Watching apiserver"
Jul 07 19:09:17.974937 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.974915    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 19:09:17.977231 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.977205    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sqbp4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","openshift-multus/multus-additional-cni-plugins-vp5xx","openshift-network-operator/iptables-alerter-cqz4p","kube-system/global-pull-secret-syncer-t6zhx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn","openshift-dns/node-resolver-2mvtb","openshift-image-registry/node-ca-wmrqh","openshift-multus/multus-9pv8k","openshift-multus/network-metrics-daemon-nxctq","openshift-network-diagnostics/network-check-target-cw4t9","openshift-ovn-kubernetes/ovnkube-node-m8klt","kube-system/konnectivity-agent-skf95"]
Jul 07 19:09:17.979070 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.979047    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.980634 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.980610    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.981518 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.981499    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 19:09:17.982179 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.981876    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.983022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.982829    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7pgc4\""
Jul 07 19:09:17.983379 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.983359    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:17.984054 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984031    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.984148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.984148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984129    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.984148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984139    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 19:09:17.984423 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 19:09:17.984517 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984501    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 19:09:17.984751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.984735    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.986154 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.985741    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:17.986154 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.985812    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcxr6\""
Jul 07 19:09:17.986154 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:17.985822    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:17.986154 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.985993    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 19:09:17.987173 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987109    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987453    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987559    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987719    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987735    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987797    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987838    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987884    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.987949    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.988223    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-59nvl\""
Jul 07 19:09:17.988417 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.988259    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.988960 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.988891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:17.990026 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.989971    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nqknm\""
Jul 07 19:09:17.990834 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.990815    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:17.991331 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-bin\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991472 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovn-node-metrics-cert\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991567 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-script-lib\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991567 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-cnibin\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.991682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.991682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-systemd-units\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22chc\" (UniqueName: \"kubernetes.io/projected/0fcb5e02-d137-49ec-9db5-8407b10fd869-kube-api-access-22chc\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqvv4\" (UniqueName: \"kubernetes.io/projected/5e686e5d-69cb-46e5-8504-ce944875c7b2-kube-api-access-qqvv4\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.991920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-registration-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.991920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-node-log\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.991920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-log-socket\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.992067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991973    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.992067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.991963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.992067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.992067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-system-cni-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.992282 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-netns\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.992282 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992105    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-device-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.992282 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-slash\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.992282 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.992187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-var-lib-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.993347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.993328    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 19:09:17.994224 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.994183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qznx5\""
Jul 07 19:09:17.995913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.994545    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 19:09:17.995913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.994941    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 19:09:17.996078 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.995972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:09:17.996376 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.996355    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.996694 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.996676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mz47m\""
Jul 07 19:09:17.997163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:17.997255 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:17.997337 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:17.997313    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:17.997428 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:17.997406    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:17.997558 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-systemd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.997614 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-ovn\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.997666 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-config\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.997826 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-env-overrides\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.997896 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-sys-fs\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.997950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.997895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bx2p\" (UniqueName: \"kubernetes.io/projected/f30bb6e9-3d7f-424c-960a-a538327f88aa-kube-api-access-2bx2p\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.998096 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998073    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5tg95\""
Jul 07 19:09:17.998155 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-etc-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.998230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.998230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-os-release\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.998331 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998248    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.998331 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.998460 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998436    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 19:09:17.998517 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.998571 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998527    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 19:09:17.998714 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-socket-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.998879 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-netd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.999022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.998999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:17.999108 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.999054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:17.999156 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.999096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-kubelet\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:17.999268 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:17.999227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.000116 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.000095    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.002390 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.002369    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 19:09:18.002487 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.002421    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xd98w\""
Jul 07 19:09:18.003126 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.003104    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 19:09:18.004369 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.004350    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 19:09:18.004576 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.004555    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-plnz9\""
Jul 07 19:09:18.030071 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.030049    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnz52"
Jul 07 19:09:18.041290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.041264    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qnz52"
Jul 07 19:09:18.082508 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.082456    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 19:09:18.100214 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-slash\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100314 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnp8g\" (UniqueName: \"kubernetes.io/projected/37622e04-0eb1-4f6a-bc8f-093aeb39912c-kube-api-access-hnp8g\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.100314 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-dbus\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.100314 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-tmp\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.100314 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-systemd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100321    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-slash\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-env-overrides\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b36354-451a-486b-b945-74a9275c8fef-serviceca\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt5t4\" (UniqueName: \"kubernetes.io/projected/1805310a-567e-4e50-825e-f1ee742864ea-kube-api-access-tt5t4\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100402    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-systemd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100506    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-etc-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100580    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100588    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-etc-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-os-release\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100692    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-os-release\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b36354-451a-486b-b945-74a9275c8fef-host\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-bin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-netd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100796    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-modprobe-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-multus\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100870    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-netd\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23fb7830-95a8-4031-b436-94b478b9cb49-hosts-file\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb7830-95a8-4031-b436-94b478b9cb49-tmp-dir\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.100925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-var-lib-kubelet\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100963    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.100965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-host\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-cnibin\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-env-overrides\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-kubernetes\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101076    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-system-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-k8s-cni-cncf-io\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101120    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-cnibin\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqb2\" (UniqueName: \"kubernetes.io/projected/23fb7830-95a8-4031-b436-94b478b9cb49-kube-api-access-hgqb2\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqvv4\" (UniqueName: \"kubernetes.io/projected/5e686e5d-69cb-46e5-8504-ce944875c7b2-kube-api-access-qqvv4\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101196    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cni-binary-copy\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101309    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-hostroot\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-daemon-config\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-node-log\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.101742 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-log-socket\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101537    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-node-log\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101605    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-run\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-device-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-systemd\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101754    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-device-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37622e04-0eb1-4f6a-bc8f-093aeb39912c-iptables-alerter-script\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-etc-kubernetes\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-var-lib-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101833    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-kubelet-config\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-sys\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-ovn\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-config\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-sys-fs\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.102422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bx2p\" (UniqueName: \"kubernetes.io/projected/f30bb6e9-3d7f-424c-960a-a538327f88aa-kube-api-access-2bx2p\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysconfig\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101970    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.101991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-conf-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-lib-modules\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-socket-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frk2\" (UniqueName: \"kubernetes.io/projected/67b36354-451a-486b-b945-74a9275c8fef-kube-api-access-6frk2\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102152    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ba88fc5-d147-4b2d-8b04-92273cba6d67-agent-certs\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvdj\" (UniqueName: \"kubernetes.io/projected/ace51aaa-649c-47f2-bc2c-c480ea530e61-kube-api-access-bwvdj\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37622e04-0eb1-4f6a-bc8f-093aeb39912c-host-slash\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-kubelet\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-bin\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovn-node-metrics-cert\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-script-lib\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.103258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102374    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cnibin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrc9\" (UniqueName: \"kubernetes.io/projected/d7ab5eef-cdd5-4d6b-8335-eccb21180795-kube-api-access-clrc9\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-systemd-units\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22chc\" (UniqueName: \"kubernetes.io/projected/0fcb5e02-d137-49ec-9db5-8407b10fd869-kube-api-access-22chc\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-registration-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-tuned\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-netns\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-system-cni-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ba88fc5-d147-4b2d-8b04-92273cba6d67-konnectivity-ca\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-conf\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-os-release\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-netns\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102803    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-socket-dir-parent\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-kubelet\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102876    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-multus-certs\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.104076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102960    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.102990    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103011    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-log-socket\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103044    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-var-lib-openvswitch\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103066    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-run-ovn\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103527    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-config\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103586    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-sys-fs\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.103905    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-socket-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104252    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f30bb6e9-3d7f-424c-960a-a538327f88aa-registration-dir\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104296    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-kubelet\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104333    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-cni-bin\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104358    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104427    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e686e5d-69cb-46e5-8504-ce944875c7b2-system-cni-dir\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104500    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-host-run-netns\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.104926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.104737    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 19:09:18.105531 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.105066    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fcb5e02-d137-49ec-9db5-8407b10fd869-systemd-units\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.105531 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.105120    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovnkube-script-lib\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.105922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.105656    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e686e5d-69cb-46e5-8504-ce944875c7b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.108918 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.108895    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fcb5e02-d137-49ec-9db5-8407b10fd869-ovn-node-metrics-cert\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.116233 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.116202    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqvv4\" (UniqueName: \"kubernetes.io/projected/5e686e5d-69cb-46e5-8504-ce944875c7b2-kube-api-access-qqvv4\") pod \"multus-additional-cni-plugins-vp5xx\" (UID: \"5e686e5d-69cb-46e5-8504-ce944875c7b2\") " pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.116688 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.116670    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bx2p\" (UniqueName: \"kubernetes.io/projected/f30bb6e9-3d7f-424c-960a-a538327f88aa-kube-api-access-2bx2p\") pod \"aws-ebs-csi-driver-node-r2jgn\" (UID: \"f30bb6e9-3d7f-424c-960a-a538327f88aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.116935 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.116916    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22chc\" (UniqueName: \"kubernetes.io/projected/0fcb5e02-d137-49ec-9db5-8407b10fd869-kube-api-access-22chc\") pod \"ovnkube-node-m8klt\" (UID: \"0fcb5e02-d137-49ec-9db5-8407b10fd869\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.203155 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cnibin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203254 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrc9\" (UniqueName: \"kubernetes.io/projected/d7ab5eef-cdd5-4d6b-8335-eccb21180795-kube-api-access-clrc9\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203254 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-tuned\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-netns\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ba88fc5-d147-4b2d-8b04-92273cba6d67-konnectivity-ca\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.203347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-conf\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-os-release\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-socket-dir-parent\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-kubelet\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-multus-certs\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnp8g\" (UniqueName: \"kubernetes.io/projected/37622e04-0eb1-4f6a-bc8f-093aeb39912c-kube-api-access-hnp8g\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.203650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-dbus\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.203650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-tmp\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b36354-451a-486b-b945-74a9275c8fef-serviceca\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.203650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt5t4\" (UniqueName: \"kubernetes.io/projected/1805310a-567e-4e50-825e-f1ee742864ea-kube-api-access-tt5t4\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.203792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:18.203792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b36354-451a-486b-b945-74a9275c8fef-host\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.203792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-bin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-modprobe-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-multus\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.203930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23fb7830-95a8-4031-b436-94b478b9cb49-hosts-file\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.203930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203820    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb7830-95a8-4031-b436-94b478b9cb49-tmp-dir\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.203930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-var-lib-kubelet\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-host\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.203930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-kubernetes\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-system-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.203978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-k8s-cni-cncf-io\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqb2\" (UniqueName: \"kubernetes.io/projected/23fb7830-95a8-4031-b436-94b478b9cb49-kube-api-access-hgqb2\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.204065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204038    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.204196 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cni-binary-copy\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204196 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-hostroot\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204196 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-daemon-config\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204196 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-run\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-systemd\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37622e04-0eb1-4f6a-bc8f-093aeb39912c-iptables-alerter-script\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.204317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-etc-kubernetes\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-kubelet-config\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.204434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-sys\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysconfig\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204387    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.204434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-conf-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.204583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-lib-modules\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frk2\" (UniqueName: \"kubernetes.io/projected/67b36354-451a-486b-b945-74a9275c8fef-kube-api-access-6frk2\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.204583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ba88fc5-d147-4b2d-8b04-92273cba6d67-agent-certs\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.204583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvdj\" (UniqueName: \"kubernetes.io/projected/ace51aaa-649c-47f2-bc2c-c480ea530e61-kube-api-access-bwvdj\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.204583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37622e04-0eb1-4f6a-bc8f-093aeb39912c-host-slash\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.204727 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204675    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37622e04-0eb1-4f6a-bc8f-093aeb39912c-host-slash\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.204759 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.204743    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cnibin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.205903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.205749    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-dbus\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.205903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.205752    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-var-lib-kubelet\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.205903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.205755    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-system-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.205903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.205773    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-host\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.205903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.205798    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67b36354-451a-486b-b945-74a9275c8fef-host\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.206440 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.206412    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-netns\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.207066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207042    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-bin\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.207242 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207186    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-modprobe-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.207430 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.207388    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:18.207520 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207449    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-cni-multus\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.207520 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.207491    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:18.707467843 +0000 UTC m=+3.115951405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207714    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23fb7830-95a8-4031-b436-94b478b9cb49-hosts-file\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207772    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-hostroot\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207857    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-run\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207914    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-tuned\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.207988    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-systemd\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208050    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-cni-binary-copy\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.208174    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:18.208219 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208177    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb7830-95a8-4031-b436-94b478b9cb49-tmp-dir\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.208239    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:18.708221504 +0000 UTC m=+3.116705040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208237    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-daemon-config\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208365    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-conf-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208435    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-kubelet-config\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208508    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37622e04-0eb1-4f6a-bc8f-093aeb39912c-iptables-alerter-script\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208541    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-lib-modules\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.208642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208585    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-sys\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.208981 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208648    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-etc-kubernetes\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.208981 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.208656    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ace51aaa-649c-47f2-bc2c-c480ea530e61-tmp\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209177    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysconfig\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209252    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-cni-dir\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209367    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-conf\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209443    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-os-release\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209498    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-var-lib-kubelet\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209552    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-sysctl-d\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209708    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ba88fc5-d147-4b2d-8b04-92273cba6d67-konnectivity-ca\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209713    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-multus-socket-dir-parent\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209763    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ace51aaa-649c-47f2-bc2c-c480ea530e61-etc-kubernetes\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209805    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-multus-certs\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.209950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209842    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ab5eef-cdd5-4d6b-8335-eccb21180795-host-run-k8s-cni-cncf-io\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.210494 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.209948    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67b36354-451a-486b-b945-74a9275c8fef-serviceca\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.211876 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.211858    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ba88fc5-d147-4b2d-8b04-92273cba6d67-agent-certs\") pod \"konnectivity-agent-skf95\" (UID: \"3ba88fc5-d147-4b2d-8b04-92273cba6d67\") " pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.218653 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.218634    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrc9\" (UniqueName: \"kubernetes.io/projected/d7ab5eef-cdd5-4d6b-8335-eccb21180795-kube-api-access-clrc9\") pod \"multus-9pv8k\" (UID: \"d7ab5eef-cdd5-4d6b-8335-eccb21180795\") " pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.227543 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.227519    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqb2\" (UniqueName: \"kubernetes.io/projected/23fb7830-95a8-4031-b436-94b478b9cb49-kube-api-access-hgqb2\") pod \"node-resolver-2mvtb\" (UID: \"23fb7830-95a8-4031-b436-94b478b9cb49\") " pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.235103 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.235069    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt5t4\" (UniqueName: \"kubernetes.io/projected/1805310a-567e-4e50-825e-f1ee742864ea-kube-api-access-tt5t4\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.235324 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.235305    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:18.235414 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.235335    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:18.235414 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.235350    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:18.235531 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.235431    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:18.735415633 +0000 UTC m=+3.143899193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:18.237955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.237936    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frk2\" (UniqueName: \"kubernetes.io/projected/67b36354-451a-486b-b945-74a9275c8fef-kube-api-access-6frk2\") pod \"node-ca-wmrqh\" (UID: \"67b36354-451a-486b-b945-74a9275c8fef\") " pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.238187 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.238170    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnp8g\" (UniqueName: \"kubernetes.io/projected/37622e04-0eb1-4f6a-bc8f-093aeb39912c-kube-api-access-hnp8g\") pod \"iptables-alerter-cqz4p\" (UID: \"37622e04-0eb1-4f6a-bc8f-093aeb39912c\") " pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.242361 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.242336    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvdj\" (UniqueName: \"kubernetes.io/projected/ace51aaa-649c-47f2-bc2c-c480ea530e61-kube-api-access-bwvdj\") pod \"tuned-sqbp4\" (UID: \"ace51aaa-649c-47f2-bc2c-c480ea530e61\") " pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.300426 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.300405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn"
Jul 07 19:09:18.306533 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.306509    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:18.317500 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.317483    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vp5xx"
Jul 07 19:09:18.323470 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.323451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqz4p"
Jul 07 19:09:18.336890 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.336839    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrqh"
Jul 07 19:09:18.344743 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.344605    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:18.353420 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.353401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqbp4"
Jul 07 19:09:18.358751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.358729    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9pv8k"
Jul 07 19:09:18.365923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.365893    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2mvtb"
Jul 07 19:09:18.709449 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.709375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:18.709449 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.709422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:18.709626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.709529    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:18.709626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.709543    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:18.709626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.709597    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:19.709575946 +0000 UTC m=+4.118059494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:18.709626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.709616    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:19.70960779 +0000 UTC m=+4.118091331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:18.809953 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.809923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:18.810092 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.810047    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:18.810092 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.810061    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:18.810092 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.810069    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:18.810265 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:18.810137    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:19.810106399 +0000 UTC m=+4.218589952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:18.986382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:18.986319    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 19:09:19.051511 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.043601    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:04:18 +0000 UTC" deadline="2028-03-31 20:05:38.861539574 +0000 UTC"
Jul 07 19:09:19.051511 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.043623    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15192h56m19.817919879s"
Jul 07 19:09:19.060884 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.060855    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37622e04_0eb1_4f6a_bc8f_093aeb39912c.slice/crio-91866392aa9ef3c8ca5528e8652f7b2ca315c8294b36b342c0bdf166a82fd3c0 WatchSource:0}: Error finding container 91866392aa9ef3c8ca5528e8652f7b2ca315c8294b36b342c0bdf166a82fd3c0: Status 404 returned error can't find the container with id 91866392aa9ef3c8ca5528e8652f7b2ca315c8294b36b342c0bdf166a82fd3c0
Jul 07 19:09:19.065924 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.065852    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30bb6e9_3d7f_424c_960a_a538327f88aa.slice/crio-cbccc7a1642b89bb1f9d21edbdf181d735609c9c074dd07289c1d9a11c22a6a5 WatchSource:0}: Error finding container cbccc7a1642b89bb1f9d21edbdf181d735609c9c074dd07289c1d9a11c22a6a5: Status 404 returned error can't find the container with id cbccc7a1642b89bb1f9d21edbdf181d735609c9c074dd07289c1d9a11c22a6a5
Jul 07 19:09:19.073709 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.073683    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba88fc5_d147_4b2d_8b04_92273cba6d67.slice/crio-5c3c68cc0b6e93f323d49ca3f105ff503b8ad939df0b1c189a0840e9bf97eaaf WatchSource:0}: Error finding container 5c3c68cc0b6e93f323d49ca3f105ff503b8ad939df0b1c189a0840e9bf97eaaf: Status 404 returned error can't find the container with id 5c3c68cc0b6e93f323d49ca3f105ff503b8ad939df0b1c189a0840e9bf97eaaf
Jul 07 19:09:19.075915 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.075890    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b36354_451a_486b_b945_74a9275c8fef.slice/crio-f6ccbc8a55ff235b248586244941c8a203c6a3f8c3e41846e1c2d04c5487e553 WatchSource:0}: Error finding container f6ccbc8a55ff235b248586244941c8a203c6a3f8c3e41846e1c2d04c5487e553: Status 404 returned error can't find the container with id f6ccbc8a55ff235b248586244941c8a203c6a3f8c3e41846e1c2d04c5487e553
Jul 07 19:09:19.076765 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.076735    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ab5eef_cdd5_4d6b_8335_eccb21180795.slice/crio-29081a73b8221a3e6abf982bdca05c243de129b8991e1853b3881ec7a0f26f97 WatchSource:0}: Error finding container 29081a73b8221a3e6abf982bdca05c243de129b8991e1853b3881ec7a0f26f97: Status 404 returned error can't find the container with id 29081a73b8221a3e6abf982bdca05c243de129b8991e1853b3881ec7a0f26f97
Jul 07 19:09:19.078303 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.078282    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e686e5d_69cb_46e5_8504_ce944875c7b2.slice/crio-00e734fd3e47d2132c7844d9b4c2ae4af1466504c5713c21dee6d81758f6a9b4 WatchSource:0}: Error finding container 00e734fd3e47d2132c7844d9b4c2ae4af1466504c5713c21dee6d81758f6a9b4: Status 404 returned error can't find the container with id 00e734fd3e47d2132c7844d9b4c2ae4af1466504c5713c21dee6d81758f6a9b4
Jul 07 19:09:19.079236 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.079143    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcb5e02_d137_49ec_9db5_8407b10fd869.slice/crio-fcf913d92ac8e0674b3634a78c44d11c91a50aeffabe2cdee3d6d723690f1201 WatchSource:0}: Error finding container fcf913d92ac8e0674b3634a78c44d11c91a50aeffabe2cdee3d6d723690f1201: Status 404 returned error can't find the container with id fcf913d92ac8e0674b3634a78c44d11c91a50aeffabe2cdee3d6d723690f1201
Jul 07 19:09:19.081935 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.081913    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace51aaa_649c_47f2_bc2c_c480ea530e61.slice/crio-43f4d6f4e28ab14560ede932a4d4f003eeff8eeb4b751fb71d1d8c4ee2b76063 WatchSource:0}: Error finding container 43f4d6f4e28ab14560ede932a4d4f003eeff8eeb4b751fb71d1d8c4ee2b76063: Status 404 returned error can't find the container with id 43f4d6f4e28ab14560ede932a4d4f003eeff8eeb4b751fb71d1d8c4ee2b76063
Jul 07 19:09:19.083073 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:09:19.083047    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fb7830_95a8_4031_b436_94b478b9cb49.slice/crio-2d47e4a5dfdb9a1f3d11fc1420280d57e6ba3f217bfc1c62a89cfc21dbbdb0b2 WatchSource:0}: Error finding container 2d47e4a5dfdb9a1f3d11fc1420280d57e6ba3f217bfc1c62a89cfc21dbbdb0b2: Status 404 returned error can't find the container with id 2d47e4a5dfdb9a1f3d11fc1420280d57e6ba3f217bfc1c62a89cfc21dbbdb0b2
Jul 07 19:09:19.170889 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.170748    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:19.171016 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.170993    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:19.171073 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.170837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:19.171148 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.171130    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:19.179461 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.179438    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerStarted","Data":"00e734fd3e47d2132c7844d9b4c2ae4af1466504c5713c21dee6d81758f6a9b4"}
Jul 07 19:09:19.180658 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.180633    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9pv8k" event={"ID":"d7ab5eef-cdd5-4d6b-8335-eccb21180795","Type":"ContainerStarted","Data":"29081a73b8221a3e6abf982bdca05c243de129b8991e1853b3881ec7a0f26f97"}
Jul 07 19:09:19.181985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.181963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrqh" event={"ID":"67b36354-451a-486b-b945-74a9275c8fef","Type":"ContainerStarted","Data":"f6ccbc8a55ff235b248586244941c8a203c6a3f8c3e41846e1c2d04c5487e553"}
Jul 07 19:09:19.183141 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.183115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn" event={"ID":"f30bb6e9-3d7f-424c-960a-a538327f88aa","Type":"ContainerStarted","Data":"cbccc7a1642b89bb1f9d21edbdf181d735609c9c074dd07289c1d9a11c22a6a5"}
Jul 07 19:09:19.185083 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.185062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"2b912bebfdf89ae599c4f63a8166d7eb","Type":"ContainerStarted","Data":"48aadf3e5420b39be8315373a49b6fda46e2dff06f872bac0725892e484bd6bb"}
Jul 07 19:09:19.186302 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.186271    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-skf95" event={"ID":"3ba88fc5-d147-4b2d-8b04-92273cba6d67","Type":"ContainerStarted","Data":"5c3c68cc0b6e93f323d49ca3f105ff503b8ad939df0b1c189a0840e9bf97eaaf"}
Jul 07 19:09:19.187404 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.187382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqz4p" event={"ID":"37622e04-0eb1-4f6a-bc8f-093aeb39912c","Type":"ContainerStarted","Data":"91866392aa9ef3c8ca5528e8652f7b2ca315c8294b36b342c0bdf166a82fd3c0"}
Jul 07 19:09:19.189043 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.189024    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2mvtb" event={"ID":"23fb7830-95a8-4031-b436-94b478b9cb49","Type":"ContainerStarted","Data":"2d47e4a5dfdb9a1f3d11fc1420280d57e6ba3f217bfc1c62a89cfc21dbbdb0b2"}
Jul 07 19:09:19.190258 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.190233    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqbp4" event={"ID":"ace51aaa-649c-47f2-bc2c-c480ea530e61","Type":"ContainerStarted","Data":"43f4d6f4e28ab14560ede932a4d4f003eeff8eeb4b751fb71d1d8c4ee2b76063"}
Jul 07 19:09:19.191823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.191771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"fcf913d92ac8e0674b3634a78c44d11c91a50aeffabe2cdee3d6d723690f1201"}
Jul 07 19:09:19.206546 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.206499    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" podStartSLOduration=1.206486053 podStartE2EDuration="1.206486053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:19.205888339 +0000 UTC m=+3.614371898" watchObservedRunningTime="2026-07-07 19:09:19.206486053 +0000 UTC m=+3.614969611"
Jul 07 19:09:19.721156 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.721069    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:19.721342 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.721192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:19.721342 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.721320    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:19.721460 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.721383    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:21.721362878 +0000 UTC m=+6.129846422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:19.721846 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.721825    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:19.721930 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.721884    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:21.721868327 +0000 UTC m=+6.130351871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:19.822494 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:19.822458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:19.822660 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.822633    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:19.822660 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.822651    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:19.822777 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.822666    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:19.822777 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:19.822725    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:21.822705688 +0000 UTC m=+6.231189230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:20.044942 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:20.044809    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:04:18 +0000 UTC" deadline="2027-12-30 05:20:30.050802434 +0000 UTC"
Jul 07 19:09:20.044942 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:20.044867    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12970h11m10.005939759s"
Jul 07 19:09:20.176775 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:20.176204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:20.176775 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:20.176331    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:20.207080 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:20.207042    2570 generic.go:356] "Generic (PLEG): container finished" podID="92b52cfa3a8376fe46556810ba765b26" containerID="ab2af3deeecd5d4021ded0b577569e56db2750689d615ed04c48f2e4a82fcd87" exitCode=0
Jul 07 19:09:20.208121 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:20.208091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"92b52cfa3a8376fe46556810ba765b26","Type":"ContainerDied","Data":"ab2af3deeecd5d4021ded0b577569e56db2750689d615ed04c48f2e4a82fcd87"}
Jul 07 19:09:21.170916 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.170887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:21.171484 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.171039    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:21.171484 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.171479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:21.171621 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.171596    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:21.218847 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.218194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"92b52cfa3a8376fe46556810ba765b26","Type":"ContainerStarted","Data":"076e4e38bc7c5a1a92f6b3e9323dfcc52893f366077b218f33c45daaa0708f50"}
Jul 07 19:09:21.738592 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.738555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:21.738796 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.738619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:21.738862 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.738794    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:21.738862 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.738854    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:25.738835773 +0000 UTC m=+10.147319326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:21.739341 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.739298    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:21.739509 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.739360    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:25.739341581 +0000 UTC m=+10.147825118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:21.840034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:21.839996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:21.840241 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.840173    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:21.840241 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.840195    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:21.840241 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.840207    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:21.840425 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:21.840273    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:25.840253965 +0000 UTC m=+10.248737517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:22.175255 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:22.175171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:22.175711 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:22.175307    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:23.171925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:23.171308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:23.171925 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:23.171441    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:23.171925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:23.171777    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:23.171925 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:23.171872    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:24.172850 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:24.172284    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:24.172850 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:24.172421    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:25.171137 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:25.171083    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:25.171346 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.171244    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:25.171833 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:25.171669    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:25.171833 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.171781    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:25.778614 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:25.778565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:25.779147 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:25.778680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:25.779147 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.778692    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:25.779147 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.778755    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:33.778735309 +0000 UTC m=+18.187218845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:25.779147 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.778799    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:25.779147 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.778853    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:33.778835967 +0000 UTC m=+18.187319507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:25.879426 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:25.879392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:25.879626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.879588    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:25.879626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.879610    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:25.879626 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.879622    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:25.879805 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:25.879666    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:33.879653325 +0000 UTC m=+18.288136874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:26.171670 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:26.171231    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:26.171670 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:26.171340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:27.170749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:27.170715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:27.171209 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:27.170830    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:27.171209 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:27.171187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:27.171362 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:27.171299    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:28.172011 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:28.171978    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:28.172517 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:28.172114    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:29.170738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:29.170709    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:29.170883 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:29.170831    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:29.170944 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:29.170888    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:29.170989 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:29.170974    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:30.171101 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:30.171060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:30.171451 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:30.171176    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:31.171385 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:31.171354    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:31.171811 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:31.171354    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:31.171811 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:31.171459    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:31.171811 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:31.171546    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:32.171207 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:32.171178    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:32.171355 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:32.171306    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:33.170527 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:33.170493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:33.171032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:33.170544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:33.171032 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.170608    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:33.171032 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.170730    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:33.843024 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:33.842985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:33.843213 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:33.843038    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:33.843213 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.843157    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:33.843213 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.843157    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:33.843325 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.843216    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:49.843198452 +0000 UTC m=+34.251681991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:33.843325 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.843235    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:09:49.843224939 +0000 UTC m=+34.251708485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:33.943499 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:33.943465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:33.943676 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.943656    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:33.943714 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.943683    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:33.943714 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.943693    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:33.943767 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:33.943739    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:49.943726304 +0000 UTC m=+34.352209838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:34.171216 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:34.171189    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:34.171571 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:34.171303    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:35.170927 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:35.170898    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:35.170927 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:35.170917    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:35.171171 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:35.170993    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:35.171171 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:35.171144    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:36.171295 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:36.171264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:36.171712 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:36.171352    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:37.170623 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:37.170588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:37.170623 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:37.170626    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:37.170852 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:37.170714    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:37.170908 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:37.170874    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:38.171355 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:38.171312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:38.171739 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:38.171440    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:39.171076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.170934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:39.171221 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.170998    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:39.171221 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:39.171168    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:39.171305 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:39.171289    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:39.259323 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.259201    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2mvtb" event={"ID":"23fb7830-95a8-4031-b436-94b478b9cb49","Type":"ContainerStarted","Data":"28c7c6c3d3dfd3d2c68c1149f998f855b6345d0d9337d98092b66144eeedc7c0"}
Jul 07 19:09:39.261229 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.261201    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqbp4" event={"ID":"ace51aaa-649c-47f2-bc2c-c480ea530e61","Type":"ContainerStarted","Data":"bd6e86ae8cefa77cd3abe4120187f9f32b08313d19317582408e382eb4125929"}
Jul 07 19:09:39.262976 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.262958    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:09:39.263253 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.263232    2570 generic.go:356] "Generic (PLEG): container finished" podID="0fcb5e02-d137-49ec-9db5-8407b10fd869" containerID="f7cd85243727328eb69b5e744587f5c43b90ad1443199d2856599a0a064f7df3" exitCode=1
Jul 07 19:09:39.263314 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.263298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"4746f08d439456e42d11e84c4e6b1bce561da3a788ab488e576ed57eb2e2b97b"}
Jul 07 19:09:39.263370 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.263359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerDied","Data":"f7cd85243727328eb69b5e744587f5c43b90ad1443199d2856599a0a064f7df3"}
Jul 07 19:09:39.263402 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.263393    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"f0d766f3017e05d285353841f509c09c15fc7c17e42e0857deb12e99496b753d"}
Jul 07 19:09:39.264693 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.264615    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="a641f6d9f252be10bf67cc8ccda0d41e8bacaf8d1c7b6f66e14fbfd1d18bda05" exitCode=0
Jul 07 19:09:39.264754 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.264686    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"a641f6d9f252be10bf67cc8ccda0d41e8bacaf8d1c7b6f66e14fbfd1d18bda05"}
Jul 07 19:09:39.266889 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.266868    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9pv8k" event={"ID":"d7ab5eef-cdd5-4d6b-8335-eccb21180795","Type":"ContainerStarted","Data":"1fabe88aa4106e689299f35aa838af8f14d966a4f8b4b80df81ee167747cc86b"}
Jul 07 19:09:39.268356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.268319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrqh" event={"ID":"67b36354-451a-486b-b945-74a9275c8fef","Type":"ContainerStarted","Data":"97cad6635e13d9199c52b342f18dec5ede6b9e5232d6840ef9c23367c271a0fb"}
Jul 07 19:09:39.270267 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.270242    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn" event={"ID":"f30bb6e9-3d7f-424c-960a-a538327f88aa","Type":"ContainerStarted","Data":"bb07c0f4391a5cb5db257c85f76c2e03b6b25d9d7cec1d4d2b261da3c34be440"}
Jul 07 19:09:39.271877 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.271854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-skf95" event={"ID":"3ba88fc5-d147-4b2d-8b04-92273cba6d67","Type":"ContainerStarted","Data":"9ab33e094b901f65367fd6674f45b984ead843d4314e312d433165748a39d3aa"}
Jul 07 19:09:39.282065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.282026    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2mvtb" podStartSLOduration=3.136361839 podStartE2EDuration="22.282010444s" totalImagesPullingTime="19.145648605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.281967726 +0000 UTC m=+23.690451281" watchObservedRunningTime="2026-07-07 19:09:39.282010444 +0000 UTC m=+23.690494000"
Jul 07 19:09:39.282671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.282628    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" podStartSLOduration=22.28262083 podStartE2EDuration="22.28262083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:21.239618392 +0000 UTC m=+5.648101952" watchObservedRunningTime="2026-07-07 19:09:39.28262083 +0000 UTC m=+23.691104399"
Jul 07 19:09:39.298249 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.298204    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-skf95" podStartSLOduration=3.142944442 podStartE2EDuration="22.298183821s" totalImagesPullingTime="19.155239379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.297848639 +0000 UTC m=+23.706332194" watchObservedRunningTime="2026-07-07 19:09:39.298183821 +0000 UTC m=+23.706667378"
Jul 07 19:09:39.318771 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.318733    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sqbp4" podStartSLOduration=2.915792814 podStartE2EDuration="22.318720929s" totalImagesPullingTime="19.402928115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.318062529 +0000 UTC m=+23.726546085" watchObservedRunningTime="2026-07-07 19:09:39.318720929 +0000 UTC m=+23.727204485"
Jul 07 19:09:39.337247 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.337210    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9pv8k" podStartSLOduration=2.900341023 podStartE2EDuration="22.3371986s" totalImagesPullingTime="19.436857577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.336782896 +0000 UTC m=+23.745266454" watchObservedRunningTime="2026-07-07 19:09:39.3371986 +0000 UTC m=+23.745682155"
Jul 07 19:09:39.377246 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:39.377213    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmrqh" podStartSLOduration=2.9807537 podStartE2EDuration="22.377191798s" totalImagesPullingTime="19.396438098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.37698802 +0000 UTC m=+23.785471576" watchObservedRunningTime="2026-07-07 19:09:39.377191798 +0000 UTC m=+23.785675333"
Jul 07 19:09:40.070465 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.070442    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 19:09:40.072665 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.072496    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T19:09:40.070462738Z","UUID":"6078432a-2153-4dcd-bffd-15a8d8d39cd0","Handler":null,"Name":"","Endpoint":""}
Jul 07 19:09:40.073899 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.073866    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 19:09:40.074024 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.073922    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 19:09:40.171163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.171119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:40.171349 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:40.171234    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:40.277304 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.277226    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:09:40.277673 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.277599    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"cfd19a49e3fb4e1dd2d22cc11783e66d5f519c685c23b4ad55b0a5c08c6ba8ed"}
Jul 07 19:09:40.277738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.277671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"8d7c4f52dc7c4336482c56d5c652e202a10b0d9dbcbbe1130e0e3e6598eec6b8"}
Jul 07 19:09:40.277738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.277713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"db52bace3676ed1b5fc9124df04b8411d05ea8501709246ebfc4cc6bcc94cb8a"}
Jul 07 19:09:40.279480 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.279451    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn" event={"ID":"f30bb6e9-3d7f-424c-960a-a538327f88aa","Type":"ContainerStarted","Data":"893e25d4b89fc4afa8f6f860ce7ebd073fc4493c7a1a893d439ab589cfdb2088"}
Jul 07 19:09:40.281006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.280924    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqz4p" event={"ID":"37622e04-0eb1-4f6a-bc8f-093aeb39912c","Type":"ContainerStarted","Data":"87df4f7f5992fe2301c81705a774ce03da8958b1016023bfe6f8ba1eb2edcaaa"}
Jul 07 19:09:40.306853 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.306805    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cqz4p" podStartSLOduration=3.883436711 podStartE2EDuration="23.306787343s" totalImagesPullingTime="19.423350632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:40.306388031 +0000 UTC m=+24.714871569" watchObservedRunningTime="2026-07-07 19:09:40.306787343 +0000 UTC m=+24.715270905"
Jul 07 19:09:40.382619 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.382594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:40.383232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:40.383210    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:41.171119 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:41.171070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:41.171405 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:41.171212    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:41.171405 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:41.171269    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:41.171512 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:41.171400    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:41.283058 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:41.283030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:41.283623 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:41.283605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-skf95"
Jul 07 19:09:42.171469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:42.171254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:42.171660 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:42.171512    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:42.287173 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:42.287137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn" event={"ID":"f30bb6e9-3d7f-424c-960a-a538327f88aa","Type":"ContainerStarted","Data":"ee8195b7f4fa390fbdc8cf35d06e2efccbb858eca66003fdc47fd9aac7a98e66"}
Jul 07 19:09:42.312060 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:42.312009    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2jgn" podStartSLOduration=3.428933466 podStartE2EDuration="25.3119905s" totalImagesPullingTime="21.883057034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:42.3112921 +0000 UTC m=+26.719775655" watchObservedRunningTime="2026-07-07 19:09:42.3119905 +0000 UTC m=+26.720474059"
Jul 07 19:09:43.171378 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:43.171343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:43.171522 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:43.171343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:43.171522 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:43.171469    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:43.171522 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:43.171511    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:44.170986 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:44.170957    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:44.171658 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:44.171044    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:44.293561 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:44.293531    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:09:44.293896 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:44.293871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"7ae415c7110c73c40db6c1fe2bbe5ff4eb2264f230cd43249638adef1e18834f"}
Jul 07 19:09:44.295546 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:44.295525    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="98a0cf016c3bc92bed5b232053f7a03026e42c597fff80e223ad1d349f632828" exitCode=0
Jul 07 19:09:44.295621 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:44.295566    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"98a0cf016c3bc92bed5b232053f7a03026e42c597fff80e223ad1d349f632828"}
Jul 07 19:09:45.171422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:45.171395    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:45.171862 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:45.171404    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:45.171862 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:45.171484    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:45.171862 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:45.171571    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:46.174005 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.173868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:46.174402 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:46.174062    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:46.302203 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302185    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:09:46.302556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"ef1701eb460063a4ae25a77c188db827bb225c9fbdd4927d13c764a091e12671"}
Jul 07 19:09:46.302850 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302818    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:46.302958 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302887    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:46.302958 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302891    2570 scope.go:117] "RemoveContainer" containerID="f7cd85243727328eb69b5e744587f5c43b90ad1443199d2856599a0a064f7df3"
Jul 07 19:09:46.302958 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.302934    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:46.304922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.304896    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="fd05e2ec82dc82ac52c8bad805e2e13374ca72d8ba0e20a3dd116bcf41f594f7" exitCode=0
Jul 07 19:09:46.305056 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.304946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"fd05e2ec82dc82ac52c8bad805e2e13374ca72d8ba0e20a3dd116bcf41f594f7"}
Jul 07 19:09:46.320145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.320127    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:46.320363 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:46.320348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:09:47.170698 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.170670    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:47.170829 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:47.170768    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:47.170875 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.170823    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:47.170930 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:47.170913    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:47.313191 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.310966    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:09:47.314459 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.314425    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" event={"ID":"0fcb5e02-d137-49ec-9db5-8407b10fd869","Type":"ContainerStarted","Data":"aca115fabf9f9f6d529153a0fa71285230acdcff3228a9da09bc28a94a861c0a"}
Jul 07 19:09:47.364842 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.364802    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt" podStartSLOduration=10.540225669 podStartE2EDuration="30.364789313s" totalImagesPullingTime="19.824563644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:47.364479486 +0000 UTC m=+31.772963042" watchObservedRunningTime="2026-07-07 19:09:47.364789313 +0000 UTC m=+31.773272869"
Jul 07 19:09:47.802610 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.802391    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxctq"]
Jul 07 19:09:47.802745 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.802731    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:47.802877 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:47.802859    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:47.807625 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.807602    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cw4t9"]
Jul 07 19:09:47.807721 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.807708    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:47.807822 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:47.807800    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:47.817317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.817289    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6zhx"]
Jul 07 19:09:47.817402 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:47.817394    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:47.817503 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:47.817483    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:48.319474 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:48.319443    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="6e7ed9c8dc56f9ca82115de127ec984772b76ea0dbe56999f202283b0d056339" exitCode=0
Jul 07 19:09:48.319925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:48.319525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"6e7ed9c8dc56f9ca82115de127ec984772b76ea0dbe56999f202283b0d056339"}
Jul 07 19:09:49.170459 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:49.170434    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:49.170607 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:49.170437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:49.170607 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.170542    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:49.170722 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.170635    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:49.868100 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:49.868001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:49.868100 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:49.868050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:49.868620 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.868168    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:49.868620 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.868173    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:49.868620 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.868228    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:10:21.868210885 +0000 UTC m=+66.276694423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 19:09:49.868620 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.868243    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret podName:5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:21.86823681 +0000 UTC m=+66.276720344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret") pod "global-pull-secret-syncer-t6zhx" (UID: "5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133") : object "kube-system"/"original-pull-secret" not registered
Jul 07 19:09:49.968920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:49.968891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:49.969075 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.969063    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 19:09:49.969166 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.969108    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 19:09:49.969166 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.969124    2570 projected.go:196] Error preparing data for projected volume kube-api-access-7tsbr for pod openshift-network-diagnostics/network-check-target-cw4t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:49.969251 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:49.969182    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr podName:526fe470-7781-44bc-9236-b161400fa945 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:21.969163499 +0000 UTC m=+66.377647047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7tsbr" (UniqueName: "kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr") pod "network-check-target-cw4t9" (UID: "526fe470-7781-44bc-9236-b161400fa945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 19:09:50.170747 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:50.170670    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:50.170890 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:50.170773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6zhx" podUID="5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133"
Jul 07 19:09:51.170711 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.170678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:51.171076 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:51.170787    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw4t9" podUID="526fe470-7781-44bc-9236-b161400fa945"
Jul 07 19:09:51.171076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.170678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:51.171076 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:51.170972    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxctq" podUID="1805310a-567e-4e50-825e-f1ee742864ea"
Jul 07 19:09:51.306868 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.306839    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeReady"
Jul 07 19:09:51.307003 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.306986    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 19:09:51.389299 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.389276    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fz7zv"]
Jul 07 19:09:51.391810 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.391791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.393312 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.393291    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vqrqp"]
Jul 07 19:09:51.394678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.394658    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g92mm\""
Jul 07 19:09:51.394912 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.394890    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 19:09:51.395182 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.395154    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 19:09:51.395264 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.395206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.398424 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.398406    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nhxfv\""
Jul 07 19:09:51.398526 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.398498    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 19:09:51.398582 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.398536    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 19:09:51.398636 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.398605    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 19:09:51.404055 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.404036    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fz7zv"]
Jul 07 19:09:51.409204 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.409189    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqrqp"]
Jul 07 19:09:51.580293 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/962359a9-367b-4f83-b5d5-6452d8e5829f-config-volume\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.580486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.580486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962359a9-367b-4f83-b5d5-6452d8e5829f-tmp-dir\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.580486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ws9q\" (UniqueName: \"kubernetes.io/projected/962359a9-367b-4f83-b5d5-6452d8e5829f-kube-api-access-6ws9q\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.580486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80134ed4-728d-435e-a083-fb2a49ffb909-cert\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.580486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.580481    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcptk\" (UniqueName: \"kubernetes.io/projected/80134ed4-728d-435e-a083-fb2a49ffb909-kube-api-access-vcptk\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.681594 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.681737 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962359a9-367b-4f83-b5d5-6452d8e5829f-tmp-dir\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.681737 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681651    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ws9q\" (UniqueName: \"kubernetes.io/projected/962359a9-367b-4f83-b5d5-6452d8e5829f-kube-api-access-6ws9q\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.681737 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80134ed4-728d-435e-a083-fb2a49ffb909-cert\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.681737 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681725    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcptk\" (UniqueName: \"kubernetes.io/projected/80134ed4-728d-435e-a083-fb2a49ffb909-kube-api-access-vcptk\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.681737 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:51.681730    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:09:51.681957 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.681779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/962359a9-367b-4f83-b5d5-6452d8e5829f-config-volume\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.681957 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:51.681802    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:09:52.181781808 +0000 UTC m=+36.590265359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:09:51.682066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.682009    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962359a9-367b-4f83-b5d5-6452d8e5829f-tmp-dir\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.682321 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.682300    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/962359a9-367b-4f83-b5d5-6452d8e5829f-config-volume\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.686301 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.686280    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80134ed4-728d-435e-a083-fb2a49ffb909-cert\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.693022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.693002    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ws9q\" (UniqueName: \"kubernetes.io/projected/962359a9-367b-4f83-b5d5-6452d8e5829f-kube-api-access-6ws9q\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:51.693624 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.693590    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcptk\" (UniqueName: \"kubernetes.io/projected/80134ed4-728d-435e-a083-fb2a49ffb909-kube-api-access-vcptk\") pod \"ingress-canary-vqrqp\" (UID: \"80134ed4-728d-435e-a083-fb2a49ffb909\") " pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:51.711363 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:51.711346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqrqp"
Jul 07 19:09:52.171472 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:52.171435    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:09:52.174782 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:52.174751    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 19:09:52.185946 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:52.185925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:52.186044 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:52.186014    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:09:52.186107 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:52.186060    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:09:53.186047764 +0000 UTC m=+37.594531298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:09:52.384080 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:52.383891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqrqp"]
Jul 07 19:09:53.171496 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.171464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:09:53.171920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.171472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:09:53.174967 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.174943    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 19:09:53.176193 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.176176    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 19:09:53.176193 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.176180    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 19:09:53.176372 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.176179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqhn7\""
Jul 07 19:09:53.176372 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.176183    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkm4d\""
Jul 07 19:09:53.193784 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.193762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:53.193902 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:53.193889    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:09:53.193965 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:53.193939    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:09:55.193925656 +0000 UTC m=+39.602409191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:09:53.335822 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.335789    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="b24e85dce6907f1c4c00d86b130c1c0904b7c08b29ef45ca86b3bee56b6da175" exitCode=0
Jul 07 19:09:53.335963 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.335896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"b24e85dce6907f1c4c00d86b130c1c0904b7c08b29ef45ca86b3bee56b6da175"}
Jul 07 19:09:53.337040 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:53.336940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqrqp" event={"ID":"80134ed4-728d-435e-a083-fb2a49ffb909","Type":"ContainerStarted","Data":"aac984fd1836791ab2f1734eaea0a7ab4ed234f352cded9e704e2342d4c2cd55"}
Jul 07 19:09:54.343792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:54.343682    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e686e5d-69cb-46e5-8504-ce944875c7b2" containerID="b17f41bf63e6dbdfbf5f616247e96bb17ed2409c253633c35fbb6f84a3a98aa5" exitCode=0
Jul 07 19:09:54.343792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:54.343739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerDied","Data":"b17f41bf63e6dbdfbf5f616247e96bb17ed2409c253633c35fbb6f84a3a98aa5"}
Jul 07 19:09:55.205753 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:55.205596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:55.205898 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:55.205735    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:09:55.205898 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:55.205854    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:09:59.20583873 +0000 UTC m=+43.614322265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:09:55.349221 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:55.349191    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" event={"ID":"5e686e5d-69cb-46e5-8504-ce944875c7b2","Type":"ContainerStarted","Data":"87923fb45be51ea30c83b70d1fec696003fa58815faa781932a637712f04a211"}
Jul 07 19:09:55.350564 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:55.350544    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqrqp" event={"ID":"80134ed4-728d-435e-a083-fb2a49ffb909","Type":"ContainerStarted","Data":"c685273f5d3d734ac01e09864b94868cc8037586db0eade6576e6b3bdb872b65"}
Jul 07 19:09:55.376654 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:55.376617    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vp5xx" podStartSLOduration=8.688234208 podStartE2EDuration="38.376604318s" totalImagesPullingTime="29.68837011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:55.374961747 +0000 UTC m=+39.783445303" watchObservedRunningTime="2026-07-07 19:09:55.376604318 +0000 UTC m=+39.785087874"
Jul 07 19:09:55.397180 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:55.395588    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vqrqp" podStartSLOduration=2.177692505 podStartE2EDuration="4.395571335s" totalImagesPullingTime="2.21787883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:55.394403011 +0000 UTC m=+39.802886563" watchObservedRunningTime="2026-07-07 19:09:55.395571335 +0000 UTC m=+39.804054891"
Jul 07 19:09:59.232509 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:09:59.232483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:09:59.232840 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:59.232601    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:09:59.232840 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:09:59.232658    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:10:07.232642326 +0000 UTC m=+51.641125861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:10:07.283813 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:07.283781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:07.284158 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:07.283893    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 19:10:07.284158 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:07.283946    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls podName:962359a9-367b-4f83-b5d5-6452d8e5829f nodeName:}" failed. No retries permitted until 2026-07-07 19:10:23.283934178 +0000 UTC m=+67.692417712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls") pod "dns-default-fz7zv" (UID: "962359a9-367b-4f83-b5d5-6452d8e5829f") : secret "dns-default-metrics-tls" not found
Jul 07 19:10:09.017391 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.017363    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lj5pj"]
Jul 07 19:10:09.038726 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.038707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lj5pj"]
Jul 07 19:10:09.038846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.038783    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.041739 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.041715    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 19:10:09.041846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.041780    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 19:10:09.041846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.041717    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 19:10:09.043292 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.043264    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jdx4k\""
Jul 07 19:10:09.043406 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.043367    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:10:09.048142 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.048123    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 19:10:09.095521 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.095493    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-config\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.095607 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.095524    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27eb14a8-7d67-4b52-9bda-7563eeb540dd-serving-cert\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.095607 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.095548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-trusted-ca\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.095607 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.095577    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skh75\" (UniqueName: \"kubernetes.io/projected/27eb14a8-7d67-4b52-9bda-7563eeb540dd-kube-api-access-skh75\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.114505 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.114484    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"]
Jul 07 19:10:09.134743 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.134724    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5778f4bf5f-tc7v6"]
Jul 07 19:10:09.134820 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.134787    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.137750 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.137730    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:10:09.137851 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.137730    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qcmwr\""
Jul 07 19:10:09.138547 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.138523    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 19:10:09.138903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.138886    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 19:10:09.139286 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.139268    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 19:10:09.158916 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.158894    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"]
Jul 07 19:10:09.158981 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.158921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5778f4bf5f-tc7v6"]
Jul 07 19:10:09.158981 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.158978    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.161805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.161785    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 19:10:09.161923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.161900    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5wszn\""
Jul 07 19:10:09.162152 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.162139    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 19:10:09.162271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.162258    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 19:10:09.162374 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.162350    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 19:10:09.162485 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.162415    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 19:10:09.162485 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.162433    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 19:10:09.196630 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.196718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-default-certificate\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.196718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.196718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa4b7948-1ac4-4255-ba20-85e184fea9cf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.196871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-stats-auth\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.196871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-config\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.196871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27eb14a8-7d67-4b52-9bda-7563eeb540dd-serving-cert\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.197021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-trusted-ca\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.197021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skh75\" (UniqueName: \"kubernetes.io/projected/27eb14a8-7d67-4b52-9bda-7563eeb540dd-kube-api-access-skh75\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.197021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196928    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5lqd\" (UniqueName: \"kubernetes.io/projected/aa4b7948-1ac4-4255-ba20-85e184fea9cf-kube-api-access-q5lqd\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.197021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.196952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hqm\" (UniqueName: \"kubernetes.io/projected/21344326-6e4b-477a-b0bf-057cffd22fd2-kube-api-access-f4hqm\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.197203 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.197075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa4b7948-1ac4-4255-ba20-85e184fea9cf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.197431 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.197414    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-config\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.197603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.197587    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27eb14a8-7d67-4b52-9bda-7563eeb540dd-trusted-ca\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.200780 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.200761    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27eb14a8-7d67-4b52-9bda-7563eeb540dd-serving-cert\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.221713 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.221686    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skh75\" (UniqueName: \"kubernetes.io/projected/27eb14a8-7d67-4b52-9bda-7563eeb540dd-kube-api-access-skh75\") pod \"console-operator-68b757fb67-lj5pj\" (UID: \"27eb14a8-7d67-4b52-9bda-7563eeb540dd\") " pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.297684 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5lqd\" (UniqueName: \"kubernetes.io/projected/aa4b7948-1ac4-4255-ba20-85e184fea9cf-kube-api-access-q5lqd\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.297764 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hqm\" (UniqueName: \"kubernetes.io/projected/21344326-6e4b-477a-b0bf-057cffd22fd2-kube-api-access-f4hqm\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.297764 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297717    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa4b7948-1ac4-4255-ba20-85e184fea9cf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.297764 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-default-certificate\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa4b7948-1ac4-4255-ba20-85e184fea9cf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.297832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-stats-auth\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.297902    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:09.797881767 +0000 UTC m=+54.206365319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:09.297913 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.297906    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 19:10:09.298156 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.297950    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:09.79793901 +0000 UTC m=+54.206422546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : secret "router-metrics-certs-default" not found
Jul 07 19:10:09.298266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.298248    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa4b7948-1ac4-4255-ba20-85e184fea9cf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.299980 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.299956    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa4b7948-1ac4-4255-ba20-85e184fea9cf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.300053 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.299993    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-stats-auth\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.300262 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.300244    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-default-certificate\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.307724 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.307699    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5lqd\" (UniqueName: \"kubernetes.io/projected/aa4b7948-1ac4-4255-ba20-85e184fea9cf-kube-api-access-q5lqd\") pod \"kube-storage-version-migrator-operator-846bf668f7-rnv26\" (UID: \"aa4b7948-1ac4-4255-ba20-85e184fea9cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.309021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.309001    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hqm\" (UniqueName: \"kubernetes.io/projected/21344326-6e4b-477a-b0bf-057cffd22fd2-kube-api-access-f4hqm\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.347605 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.347584    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:09.443164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.443138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"
Jul 07 19:10:09.529500 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.529472    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lj5pj"]
Jul 07 19:10:09.533969 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:09.533947    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eb14a8_7d67_4b52_9bda_7563eeb540dd.slice/crio-af0fb20559e0c85e7590372e16d89b5928c674350fa097a2c00f900fdb36f137 WatchSource:0}: Error finding container af0fb20559e0c85e7590372e16d89b5928c674350fa097a2c00f900fdb36f137: Status 404 returned error can't find the container with id af0fb20559e0c85e7590372e16d89b5928c674350fa097a2c00f900fdb36f137
Jul 07 19:10:09.590913 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.590850    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26"]
Jul 07 19:10:09.594072 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:09.594052    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4b7948_1ac4_4255_ba20_85e184fea9cf.slice/crio-2ed6a4a7cf149141fadba3f9178f640be0750315db52ca7b48ebe4d463876cb8 WatchSource:0}: Error finding container 2ed6a4a7cf149141fadba3f9178f640be0750315db52ca7b48ebe4d463876cb8: Status 404 returned error can't find the container with id 2ed6a4a7cf149141fadba3f9178f640be0750315db52ca7b48ebe4d463876cb8
Jul 07 19:10:09.802116 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.802079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.802204 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:09.802125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:09.802242 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.802217    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 19:10:09.802242 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.802223    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:10.80220881 +0000 UTC m=+55.210692349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:09.802307 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:09.802255    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:10.802244002 +0000 UTC m=+55.210727567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : secret "router-metrics-certs-default" not found
Jul 07 19:10:10.383268 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:10.383241    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" event={"ID":"27eb14a8-7d67-4b52-9bda-7563eeb540dd","Type":"ContainerStarted","Data":"af0fb20559e0c85e7590372e16d89b5928c674350fa097a2c00f900fdb36f137"}
Jul 07 19:10:10.384361 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:10.384341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26" event={"ID":"aa4b7948-1ac4-4255-ba20-85e184fea9cf","Type":"ContainerStarted","Data":"2ed6a4a7cf149141fadba3f9178f640be0750315db52ca7b48ebe4d463876cb8"}
Jul 07 19:10:10.811041 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:10.811006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:10.811210 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:10.811049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:10.811210 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:10.811158    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 19:10:10.811210 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:10.811180    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:12.811162211 +0000 UTC m=+57.219645746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:10.811210 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:10.811204    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:12.81119287 +0000 UTC m=+57.219676404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : secret "router-metrics-certs-default" not found
Jul 07 19:10:12.825872 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:12.825833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:12.826358 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:12.825884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:12.826358 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:12.826008    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 19:10:12.826358 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:12.826030    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:16.826007911 +0000 UTC m=+61.234491446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:12.826358 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:12.826065    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:16.826049179 +0000 UTC m=+61.234532739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : secret "router-metrics-certs-default" not found
Jul 07 19:10:13.169428 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.169407    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l645h"]
Jul 07 19:10:13.171376 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.171362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.175370 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.175351    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 19:10:13.175592 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.175577    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 19:10:13.175727 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.175713    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 19:10:13.175801 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.175776    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f8xvk\""
Jul 07 19:10:13.176707 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.176689    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 19:10:13.185507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.185485    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l645h"]
Jul 07 19:10:13.229121 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.229101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3351daee-222c-47dc-ad60-a89042824694-crio-socket\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.229121 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.229128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3351daee-222c-47dc-ad60-a89042824694-data-volume\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.229273 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.229169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.229273 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.229185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddsz\" (UniqueName: \"kubernetes.io/projected/3351daee-222c-47dc-ad60-a89042824694-kube-api-access-rddsz\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.229273 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.229223    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330256 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3351daee-222c-47dc-ad60-a89042824694-crio-socket\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3351daee-222c-47dc-ad60-a89042824694-data-volume\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330434 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rddsz\" (UniqueName: \"kubernetes.io/projected/3351daee-222c-47dc-ad60-a89042824694-kube-api-access-rddsz\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330434 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.330407    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:13.330547 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.330468    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:10:13.330547 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.330473    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:13.830453841 +0000 UTC m=+58.238937381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:13.330547 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.330536    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:13.830520542 +0000 UTC m=+58.239004077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : configmap "kube-rbac-proxy" not found
Jul 07 19:10:13.330652 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330547    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3351daee-222c-47dc-ad60-a89042824694-crio-socket\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.330699 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.330683    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3351daee-222c-47dc-ad60-a89042824694-data-volume\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.345679 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.345627    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddsz\" (UniqueName: \"kubernetes.io/projected/3351daee-222c-47dc-ad60-a89042824694-kube-api-access-rddsz\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.393107 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.393064    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26" event={"ID":"aa4b7948-1ac4-4255-ba20-85e184fea9cf","Type":"ContainerStarted","Data":"e5c38cb85dd1f968fcb89d1477594eadf615a3ac37620c1a7c62f1d41722cab5"}
Jul 07 19:10:13.394771 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.394754    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/0.log"
Jul 07 19:10:13.394841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.394792    2570 generic.go:356] "Generic (PLEG): container finished" podID="27eb14a8-7d67-4b52-9bda-7563eeb540dd" containerID="ff5c40c79c3cc52143ec1cc80d1f7537cad745e1207e8ebfcfc3adf57b35b936" exitCode=255
Jul 07 19:10:13.394841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.394818    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" event={"ID":"27eb14a8-7d67-4b52-9bda-7563eeb540dd","Type":"ContainerDied","Data":"ff5c40c79c3cc52143ec1cc80d1f7537cad745e1207e8ebfcfc3adf57b35b936"}
Jul 07 19:10:13.394981 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.394969    2570 scope.go:117] "RemoveContainer" containerID="ff5c40c79c3cc52143ec1cc80d1f7537cad745e1207e8ebfcfc3adf57b35b936"
Jul 07 19:10:13.412431 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.412394    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26" podStartSLOduration=1.028798883 podStartE2EDuration="4.412382176s" totalImagesPullingTime="3.383583293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:13.412211626 +0000 UTC m=+57.820695182" watchObservedRunningTime="2026-07-07 19:10:13.412382176 +0000 UTC m=+57.820865711"
Jul 07 19:10:13.835696 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.835672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.835995 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:13.835713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:13.835995 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.835796    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:10:13.835995 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.835824    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:13.835995 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.835866    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:14.835849202 +0000 UTC m=+59.244332741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : configmap "kube-rbac-proxy" not found
Jul 07 19:10:13.835995 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:13.835885    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:14.835876225 +0000 UTC m=+59.244359765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:14.398782 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.398758    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:10:14.399131 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.399115    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/0.log"
Jul 07 19:10:14.399227 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.399152    2570 generic.go:356] "Generic (PLEG): container finished" podID="27eb14a8-7d67-4b52-9bda-7563eeb540dd" containerID="3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e" exitCode=255
Jul 07 19:10:14.399288 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.399229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" event={"ID":"27eb14a8-7d67-4b52-9bda-7563eeb540dd","Type":"ContainerDied","Data":"3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e"}
Jul 07 19:10:14.399339 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.399288    2570 scope.go:117] "RemoveContainer" containerID="ff5c40c79c3cc52143ec1cc80d1f7537cad745e1207e8ebfcfc3adf57b35b936"
Jul 07 19:10:14.399454 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.399435    2570 scope.go:117] "RemoveContainer" containerID="3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e"
Jul 07 19:10:14.399623 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:14.399603    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lj5pj_openshift-console-operator(27eb14a8-7d67-4b52-9bda-7563eeb540dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" podUID="27eb14a8-7d67-4b52-9bda-7563eeb540dd"
Jul 07 19:10:14.843798 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.843777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:14.844051 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.843856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:14.844051 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:14.843903    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:14.844051 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:14.843912    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:10:14.844051 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:14.843956    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:16.843942339 +0000 UTC m=+61.252425873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:14.844051 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:14.843970    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:16.843964053 +0000 UTC m=+61.252447587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : configmap "kube-rbac-proxy" not found
Jul 07 19:10:14.957261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:14.957243    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2mvtb_23fb7830-95a8-4031-b436-94b478b9cb49/dns-node-resolver/0.log"
Jul 07 19:10:15.324000 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.323978    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"]
Jul 07 19:10:15.326332 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.326312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"
Jul 07 19:10:15.329150 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.329135    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 19:10:15.329377 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.329354    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zv2s7\""
Jul 07 19:10:15.329460 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.329396    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 19:10:15.337836 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.337815    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"]
Jul 07 19:10:15.347777 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.347755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6sdd\" (UniqueName: \"kubernetes.io/projected/99b53441-6f56-484f-bc81-a82f1d50af5e-kube-api-access-s6sdd\") pod \"migrator-d57d58cc9-bbdtc\" (UID: \"99b53441-6f56-484f-bc81-a82f1d50af5e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"
Jul 07 19:10:15.402257 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.402242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:10:15.402546 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.402531    2570 scope.go:117] "RemoveContainer" containerID="3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e"
Jul 07 19:10:15.402676 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:15.402660    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lj5pj_openshift-console-operator(27eb14a8-7d67-4b52-9bda-7563eeb540dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" podUID="27eb14a8-7d67-4b52-9bda-7563eeb540dd"
Jul 07 19:10:15.448730 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.448702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6sdd\" (UniqueName: \"kubernetes.io/projected/99b53441-6f56-484f-bc81-a82f1d50af5e-kube-api-access-s6sdd\") pod \"migrator-d57d58cc9-bbdtc\" (UID: \"99b53441-6f56-484f-bc81-a82f1d50af5e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"
Jul 07 19:10:15.459904 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.459881    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6sdd\" (UniqueName: \"kubernetes.io/projected/99b53441-6f56-484f-bc81-a82f1d50af5e-kube-api-access-s6sdd\") pod \"migrator-d57d58cc9-bbdtc\" (UID: \"99b53441-6f56-484f-bc81-a82f1d50af5e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"
Jul 07 19:10:15.634598 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.634546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"
Jul 07 19:10:15.765492 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:15.765468    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc"]
Jul 07 19:10:15.768680 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:15.768661    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b53441_6f56_484f_bc81_a82f1d50af5e.slice/crio-2a89e72f0f6da4cdcf0c30572e1678599d1838ad1a16c8a947d136bf3a9be4f5 WatchSource:0}: Error finding container 2a89e72f0f6da4cdcf0c30572e1678599d1838ad1a16c8a947d136bf3a9be4f5: Status 404 returned error can't find the container with id 2a89e72f0f6da4cdcf0c30572e1678599d1838ad1a16c8a947d136bf3a9be4f5
Jul 07 19:10:16.157163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.157141    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrqh_67b36354-451a-486b-b945-74a9275c8fef/node-ca/0.log"
Jul 07 19:10:16.405428 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.405392    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc" event={"ID":"99b53441-6f56-484f-bc81-a82f1d50af5e","Type":"ContainerStarted","Data":"2a89e72f0f6da4cdcf0c30572e1678599d1838ad1a16c8a947d136bf3a9be4f5"}
Jul 07 19:10:16.858265 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.858236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:16.858421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.858281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:16.858421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.858312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:16.858421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.858345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:16.858421 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858378    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858430    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:24.858411165 +0000 UTC m=+69.266894713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858457    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:20.858446491 +0000 UTC m=+65.266930027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : configmap "kube-rbac-proxy" not found
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858489    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858489    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858547    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:20.858530126 +0000 UTC m=+65.267013676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:16.858750 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:16.858571    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:24.858560712 +0000 UTC m=+69.267044249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : secret "router-metrics-certs-default" not found
Jul 07 19:10:16.963626 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:16.963600    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqrqp_80134ed4-728d-435e-a083-fb2a49ffb909/serve-healthcheck-canary/0.log"
Jul 07 19:10:18.329181 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:18.329161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8klt"
Jul 07 19:10:18.412355 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:18.412331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc" event={"ID":"99b53441-6f56-484f-bc81-a82f1d50af5e","Type":"ContainerStarted","Data":"c62c2058d3fb675c23366cf1f536b9f46bec9db3a50e51ec5301914e1bbca6f5"}
Jul 07 19:10:18.412499 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:18.412369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc" event={"ID":"99b53441-6f56-484f-bc81-a82f1d50af5e","Type":"ContainerStarted","Data":"b5159aa17bba5434a3bcb8d6198d35cb36a974a37632e58bdaba2f8b17d1500c"}
Jul 07 19:10:18.433995 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:18.433953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bbdtc" podStartSLOduration=1.496561284 podStartE2EDuration="3.433941009s" totalImagesPullingTime="1.937379725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:18.433213783 +0000 UTC m=+62.841697338" watchObservedRunningTime="2026-07-07 19:10:18.433941009 +0000 UTC m=+62.842424564"
Jul 07 19:10:19.347906 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:19.347880    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:19.348416 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:19.347924    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:19.348416 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:19.348322    2570 scope.go:117] "RemoveContainer" containerID="3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e"
Jul 07 19:10:19.348530 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:19.348489    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lj5pj_openshift-console-operator(27eb14a8-7d67-4b52-9bda-7563eeb540dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" podUID="27eb14a8-7d67-4b52-9bda-7563eeb540dd"
Jul 07 19:10:20.887991 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:20.887958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:20.888331 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:20.888002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:20.888331 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:20.888065    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 19:10:20.888331 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:20.888120    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:20.888331 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:20.888138    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:28.88812405 +0000 UTC m=+73.296607584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : configmap "kube-rbac-proxy" not found
Jul 07 19:10:20.888331 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:20.888157    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls podName:3351daee-222c-47dc-ad60-a89042824694 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:28.888146072 +0000 UTC m=+73.296629606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l645h" (UID: "3351daee-222c-47dc-ad60-a89042824694") : secret "insights-runtime-extractor-tls" not found
Jul 07 19:10:21.894130 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.894072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:10:21.894494 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.894141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:10:21.897468 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.897449    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 19:10:21.897522 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.897466    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 19:10:21.904483 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:21.904468    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 19:10:21.904565 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:21.904525    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs podName:1805310a-567e-4e50-825e-f1ee742864ea nodeName:}" failed. No retries permitted until 2026-07-07 19:11:25.904509329 +0000 UTC m=+130.312992864 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs") pod "network-metrics-daemon-nxctq" (UID: "1805310a-567e-4e50-825e-f1ee742864ea") : secret "metrics-daemon-secret" not found
Jul 07 19:10:21.906537 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.906522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133-original-pull-secret\") pod \"global-pull-secret-syncer-t6zhx\" (UID: \"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133\") " pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:10:21.995275 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.995256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:10:21.998543 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:21.998527    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 19:10:22.008503 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.008487    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 19:10:22.018813 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.018797    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsbr\" (UniqueName: \"kubernetes.io/projected/526fe470-7781-44bc-9236-b161400fa945-kube-api-access-7tsbr\") pod \"network-check-target-cw4t9\" (UID: \"526fe470-7781-44bc-9236-b161400fa945\") " pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:10:22.182749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.182707    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6zhx"
Jul 07 19:10:22.285531 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.285509    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkm4d\""
Jul 07 19:10:22.293404 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.293384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:10:22.300205 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.300186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6zhx"]
Jul 07 19:10:22.303010 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:22.302992    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb6a5d3_d7b8_4bf5_b82f_58a9fccf7133.slice/crio-310435b4a9ce321a2c55e3aa5b14c072ad9feaf2a86867fccf1de147ab94775d WatchSource:0}: Error finding container 310435b4a9ce321a2c55e3aa5b14c072ad9feaf2a86867fccf1de147ab94775d: Status 404 returned error can't find the container with id 310435b4a9ce321a2c55e3aa5b14c072ad9feaf2a86867fccf1de147ab94775d
Jul 07 19:10:22.413007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.412988    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cw4t9"]
Jul 07 19:10:22.415361 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:22.415336    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526fe470_7781_44bc_9236_b161400fa945.slice/crio-08bfbcbbeb1df18ba320a612c54047308913909ee50c30e5adaa8f09b317a0f0 WatchSource:0}: Error finding container 08bfbcbbeb1df18ba320a612c54047308913909ee50c30e5adaa8f09b317a0f0: Status 404 returned error can't find the container with id 08bfbcbbeb1df18ba320a612c54047308913909ee50c30e5adaa8f09b317a0f0
Jul 07 19:10:22.424304 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.424278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cw4t9" event={"ID":"526fe470-7781-44bc-9236-b161400fa945","Type":"ContainerStarted","Data":"08bfbcbbeb1df18ba320a612c54047308913909ee50c30e5adaa8f09b317a0f0"}
Jul 07 19:10:22.425142 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:22.425123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6zhx" event={"ID":"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133","Type":"ContainerStarted","Data":"310435b4a9ce321a2c55e3aa5b14c072ad9feaf2a86867fccf1de147ab94775d"}
Jul 07 19:10:23.306467 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:23.306431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:23.310709 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:23.310682    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/962359a9-367b-4f83-b5d5-6452d8e5829f-metrics-tls\") pod \"dns-default-fz7zv\" (UID: \"962359a9-367b-4f83-b5d5-6452d8e5829f\") " pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:23.506251 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:23.506218    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g92mm\""
Jul 07 19:10:23.513914 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:23.513881    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:23.668883 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:23.668853    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fz7zv"]
Jul 07 19:10:23.673851 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:23.673819    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962359a9_367b_4f83_b5d5_6452d8e5829f.slice/crio-f0aae30804cf047769511be999bed5ee3cd65e0bc077052fdf6d88cbd9a8dcec WatchSource:0}: Error finding container f0aae30804cf047769511be999bed5ee3cd65e0bc077052fdf6d88cbd9a8dcec: Status 404 returned error can't find the container with id f0aae30804cf047769511be999bed5ee3cd65e0bc077052fdf6d88cbd9a8dcec
Jul 07 19:10:24.433104 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:24.433012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fz7zv" event={"ID":"962359a9-367b-4f83-b5d5-6452d8e5829f","Type":"ContainerStarted","Data":"f0aae30804cf047769511be999bed5ee3cd65e0bc077052fdf6d88cbd9a8dcec"}
Jul 07 19:10:24.916678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:24.916646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:24.916854 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:24.916691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:24.916854 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:24.916840    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle podName:21344326-6e4b-477a-b0bf-057cffd22fd2 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:40.916816009 +0000 UTC m=+85.325299557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle") pod "router-default-5778f4bf5f-tc7v6" (UID: "21344326-6e4b-477a-b0bf-057cffd22fd2") : configmap references non-existent config key: service-ca.crt
Jul 07 19:10:24.919442 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:24.919421    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21344326-6e4b-477a-b0bf-057cffd22fd2-metrics-certs\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:28.454163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.454131    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cw4t9" event={"ID":"526fe470-7781-44bc-9236-b161400fa945","Type":"ContainerStarted","Data":"f856211d35da4a9c7de8bd23de5beee7625e53780290bb94bf7252388f162413"}
Jul 07 19:10:28.454537 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.454203    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:10:28.455463 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.455439    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6zhx" event={"ID":"5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133","Type":"ContainerStarted","Data":"6690e546face17ef1cf3206d1ecd5ba941626a72e7f283f9fcbf404e2f638081"}
Jul 07 19:10:28.456994 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.456975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fz7zv" event={"ID":"962359a9-367b-4f83-b5d5-6452d8e5829f","Type":"ContainerStarted","Data":"56b860d73a683e5acff3d808abafa425ec119b77c4e7d5f5dcb83dd80922b4e1"}
Jul 07 19:10:28.457099 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.457010    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fz7zv" event={"ID":"962359a9-367b-4f83-b5d5-6452d8e5829f","Type":"ContainerStarted","Data":"7f70c65c3d97aef55e79e101684bafc1d3ca797c2b6ab6688bf6eb6b1b8b835d"}
Jul 07 19:10:28.457099 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.457044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:28.476812 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.476772    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cw4t9" podStartSLOduration=66.383780261 podStartE2EDuration="1m11.476760669s" totalImagesPullingTime="5.092980408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:28.475146701 +0000 UTC m=+72.883630256" watchObservedRunningTime="2026-07-07 19:10:28.476760669 +0000 UTC m=+72.885244226"
Jul 07 19:10:28.494968 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.494934    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t6zhx" podStartSLOduration=66.300057346 podStartE2EDuration="1m11.494922199s" totalImagesPullingTime="5.194864853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:28.493896835 +0000 UTC m=+72.902380390" watchObservedRunningTime="2026-07-07 19:10:28.494922199 +0000 UTC m=+72.903405755"
Jul 07 19:10:28.513647 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.513614    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fz7zv" podStartSLOduration=33.684208242 podStartE2EDuration="37.513602902s" totalImagesPullingTime="3.82939466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:28.51292444 +0000 UTC m=+72.921407995" watchObservedRunningTime="2026-07-07 19:10:28.513602902 +0000 UTC m=+72.922086457"
Jul 07 19:10:28.944358 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.944334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:28.944463 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.944372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:28.944872 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.944856    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3351daee-222c-47dc-ad60-a89042824694-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:28.946636 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:28.946609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3351daee-222c-47dc-ad60-a89042824694-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l645h\" (UID: \"3351daee-222c-47dc-ad60-a89042824694\") " pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:29.082445 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:29.082422    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f8xvk\""
Jul 07 19:10:29.089708 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:29.089689    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l645h"
Jul 07 19:10:29.212001 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:29.211944    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l645h"]
Jul 07 19:10:29.214742 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:29.214711    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3351daee_222c_47dc_ad60_a89042824694.slice/crio-21a93fb36b9656111d13ac78e77fcfcf3192aba6a33d6067dc9fb458f91071d5 WatchSource:0}: Error finding container 21a93fb36b9656111d13ac78e77fcfcf3192aba6a33d6067dc9fb458f91071d5: Status 404 returned error can't find the container with id 21a93fb36b9656111d13ac78e77fcfcf3192aba6a33d6067dc9fb458f91071d5
Jul 07 19:10:29.461325 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:29.461297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l645h" event={"ID":"3351daee-222c-47dc-ad60-a89042824694","Type":"ContainerStarted","Data":"21a93fb36b9656111d13ac78e77fcfcf3192aba6a33d6067dc9fb458f91071d5"}
Jul 07 19:10:31.171576 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:31.171545    2570 scope.go:117] "RemoveContainer" containerID="3458e0892b1a6d3c815f95786f3edadff35f4eb3abf831ad152143265a46249e"
Jul 07 19:10:33.477978 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.477948    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l645h" event={"ID":"3351daee-222c-47dc-ad60-a89042824694","Type":"ContainerStarted","Data":"b921ed2fa98566893b823d9b58867bb69f5248bf532f9b5d010feee88a37c9f2"}
Jul 07 19:10:33.479792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.479775    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:10:33.479894 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.479834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" event={"ID":"27eb14a8-7d67-4b52-9bda-7563eeb540dd","Type":"ContainerStarted","Data":"3c473e02c60ad2b6fd02cb9718043e026dd66b89a096d15afb397896358ee56e"}
Jul 07 19:10:33.480147 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.480119    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:33.498834 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.498795    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj" podStartSLOduration=22.060528792 podStartE2EDuration="25.498778241s" totalImagesPullingTime="3.438249449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:33.49845429 +0000 UTC m=+77.906937844" watchObservedRunningTime="2026-07-07 19:10:33.498778241 +0000 UTC m=+77.907261797"
Jul 07 19:10:33.664586 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:33.664559    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-lj5pj"
Jul 07 19:10:34.485074 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:34.485035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l645h" event={"ID":"3351daee-222c-47dc-ad60-a89042824694","Type":"ContainerStarted","Data":"3025b45203f82337372c424f141e47e37492d76053b0317ee57c443838a2decc"}
Jul 07 19:10:36.493442 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:36.493331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l645h" event={"ID":"3351daee-222c-47dc-ad60-a89042824694","Type":"ContainerStarted","Data":"339a4b1691bde2618c50a5871f5dde695b581b8dae1d4b951d7e4c6a765d055b"}
Jul 07 19:10:36.514238 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:36.514197    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l645h" podStartSLOduration=16.921396384 podStartE2EDuration="23.514182248s" totalImagesPullingTime="6.592785864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:10:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:36.513375337 +0000 UTC m=+80.921858894" watchObservedRunningTime="2026-07-07 19:10:36.514182248 +0000 UTC m=+80.922665804"
Jul 07 19:10:38.463762 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:38.463737    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fz7zv"
Jul 07 19:10:40.925055 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:40.925027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:40.925533 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:40.925516    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21344326-6e4b-477a-b0bf-057cffd22fd2-service-ca-bundle\") pod \"router-default-5778f4bf5f-tc7v6\" (UID: \"21344326-6e4b-477a-b0bf-057cffd22fd2\") " pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:40.970560 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:40.970541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5wszn\""
Jul 07 19:10:40.978093 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:40.978076    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:41.103926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.103797    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5778f4bf5f-tc7v6"]
Jul 07 19:10:41.106380 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:41.106354    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21344326_6e4b_477a_b0bf_057cffd22fd2.slice/crio-586581607f1e5d9de68de8074c6b6db0948c05ac592eb9feb31fa20993e5c910 WatchSource:0}: Error finding container 586581607f1e5d9de68de8074c6b6db0948c05ac592eb9feb31fa20993e5c910: Status 404 returned error can't find the container with id 586581607f1e5d9de68de8074c6b6db0948c05ac592eb9feb31fa20993e5c910
Jul 07 19:10:41.512429 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.512393    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6" event={"ID":"21344326-6e4b-477a-b0bf-057cffd22fd2","Type":"ContainerStarted","Data":"1e871a6531e904689672126fdfdcbdf5a79528fdd48e9240ec9089689a62fdc9"}
Jul 07 19:10:41.512586 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.512464    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6" event={"ID":"21344326-6e4b-477a-b0bf-057cffd22fd2","Type":"ContainerStarted","Data":"586581607f1e5d9de68de8074c6b6db0948c05ac592eb9feb31fa20993e5c910"}
Jul 07 19:10:41.536518 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.536475    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6" podStartSLOduration=32.53646317 podStartE2EDuration="32.53646317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:41.535942035 +0000 UTC m=+85.944425591" watchObservedRunningTime="2026-07-07 19:10:41.53646317 +0000 UTC m=+85.944946726"
Jul 07 19:10:41.593616 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.593591    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"]
Jul 07 19:10:41.595704 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.595690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.598502 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.598483    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 19:10:41.598804 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.598790    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 19:10:41.598882 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.598864    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 19:10:41.599163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.599146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 19:10:41.599238 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.599187    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 19:10:41.599238 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.599192    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 19:10:41.599629 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.599613    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 19:10:41.612553 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.612527    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"]
Jul 07 19:10:41.731491 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmf54\" (UniqueName: \"kubernetes.io/projected/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-kube-api-access-qmf54\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.731580 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.731580 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.731580 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.731679 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.731679 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.731660    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832045 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832148 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832294 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832294 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmf54\" (UniqueName: \"kubernetes.io/projected/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-kube-api-access-qmf54\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.832788 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.832699    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.834513 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.834486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.834649 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.834632    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.834912 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.834897    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-hub\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.834948 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.834900    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-ca\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.841629 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.841613    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmf54\" (UniqueName: \"kubernetes.io/projected/f3bf7de0-2885-4a8c-aa89-ea4d9381b31a-kube-api-access-qmf54\") pod \"cluster-proxy-proxy-agent-5968fd6698-jlzc7\" (UID: \"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.914215 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.914194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"
Jul 07 19:10:41.978923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.978900    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:41.981351 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:41.981332    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:42.041871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:42.041848    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7"]
Jul 07 19:10:42.044911 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:42.044891    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3bf7de0_2885_4a8c_aa89_ea4d9381b31a.slice/crio-a8a2c83584168972443132267af7f0dc0b35e75071b2c00efb392c2256b05bae WatchSource:0}: Error finding container a8a2c83584168972443132267af7f0dc0b35e75071b2c00efb392c2256b05bae: Status 404 returned error can't find the container with id a8a2c83584168972443132267af7f0dc0b35e75071b2c00efb392c2256b05bae
Jul 07 19:10:42.517784 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:42.517724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7" event={"ID":"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a","Type":"ContainerStarted","Data":"a8a2c83584168972443132267af7f0dc0b35e75071b2c00efb392c2256b05bae"}
Jul 07 19:10:42.518058 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:42.518016    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:42.519319 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:42.519300    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5778f4bf5f-tc7v6"
Jul 07 19:10:45.530917 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:45.530841    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7" event={"ID":"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a","Type":"ContainerStarted","Data":"4f5c0bbc9ed0c15c5bc18103b52c29fe3d2da27de1f06ee25a18f99f4ecc618e"}
Jul 07 19:10:45.530917 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:45.530882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7" event={"ID":"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a","Type":"ContainerStarted","Data":"1af467a91d4c70471670ab2e4fd236d56dc458decaebd99143a694a24b91aaaf"}
Jul 07 19:10:45.530917 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:45.530894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7" event={"ID":"f3bf7de0-2885-4a8c-aa89-ea4d9381b31a","Type":"ContainerStarted","Data":"b5043ae8ebccd324fe6eb8cf13c61a961325802eb93372616f02bc5e641c2360"}
Jul 07 19:10:45.553221 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:45.553180    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5968fd6698-jlzc7" podStartSLOduration=1.449319422 podStartE2EDuration="4.553166542s" totalImagesPullingTime="3.10384712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:45.551783472 +0000 UTC m=+89.960267039" watchObservedRunningTime="2026-07-07 19:10:45.553166542 +0000 UTC m=+89.961650098"
Jul 07 19:10:54.956562 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.956533    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kz7dk"]
Jul 07 19:10:54.959814 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.959799    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:54.962521 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.962497    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 19:10:54.962643 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.962556    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 19:10:54.963806 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.963787    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 19:10:54.963949 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.963805    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 19:10:54.963949 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.963812    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 19:10:54.963949 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.963813    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 19:10:54.963949 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:54.963813    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wzk4r\""
Jul 07 19:10:55.015719 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-sys\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.015830 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-wtmp\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.015830 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.015830 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-metrics-client-ca\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.015830 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.016007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-textfile\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.016007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-root\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.016007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.016007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.015923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntl7\" (UniqueName: \"kubernetes.io/projected/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-kube-api-access-2ntl7\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.116764 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-sys\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.116869 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116773    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-wtmp\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.116869 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.116869 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-metrics-client-ca\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.116869 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116855    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-sys\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-textfile\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116940    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-wtmp\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-root\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.116991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.117020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntl7\" (UniqueName: \"kubernetes.io/projected/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-kube-api-access-2ntl7\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.117072    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-root\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117422 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:55.117122    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 19:10:55.117422 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:10:55.117181    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls podName:b4e13868-6f0d-4d6c-91c0-38c61d4e5e37 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:55.617163972 +0000 UTC m=+100.025647519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls") pod "node-exporter-kz7dk" (UID: "b4e13868-6f0d-4d6c-91c0-38c61d4e5e37") : secret "node-exporter-tls" not found
Jul 07 19:10:55.117550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.117453    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-textfile\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.117459    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.117664 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.117648    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-metrics-client-ca\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.119385 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.119365    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.132836 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.132776    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntl7\" (UniqueName: \"kubernetes.io/projected/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-kube-api-access-2ntl7\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.621005 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.620975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.623445 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.623422    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4e13868-6f0d-4d6c-91c0-38c61d4e5e37-node-exporter-tls\") pod \"node-exporter-kz7dk\" (UID: \"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37\") " pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.868774 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:55.868749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kz7dk"
Jul 07 19:10:55.879816 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:10:55.879794    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e13868_6f0d_4d6c_91c0_38c61d4e5e37.slice/crio-8c8236556b7eda1cd9f5644c991fd0d5801465460eb1ac6ea08c8aa153f00a0f WatchSource:0}: Error finding container 8c8236556b7eda1cd9f5644c991fd0d5801465460eb1ac6ea08c8aa153f00a0f: Status 404 returned error can't find the container with id 8c8236556b7eda1cd9f5644c991fd0d5801465460eb1ac6ea08c8aa153f00a0f
Jul 07 19:10:56.567772 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:56.567741    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz7dk" event={"ID":"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37","Type":"ContainerStarted","Data":"8c8236556b7eda1cd9f5644c991fd0d5801465460eb1ac6ea08c8aa153f00a0f"}
Jul 07 19:10:57.572824 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:57.572797    2570 generic.go:356] "Generic (PLEG): container finished" podID="b4e13868-6f0d-4d6c-91c0-38c61d4e5e37" containerID="5ddf7950052b3c98e83c71c7f7af0fe7f911bb2a590f1a9e711701c57273eb16" exitCode=0
Jul 07 19:10:57.573161 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:57.572887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz7dk" event={"ID":"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37","Type":"ContainerDied","Data":"5ddf7950052b3c98e83c71c7f7af0fe7f911bb2a590f1a9e711701c57273eb16"}
Jul 07 19:10:58.578485 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:58.578459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz7dk" event={"ID":"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37","Type":"ContainerStarted","Data":"97558e9c309610d64e6c3f4bcb88e81b65db21c29a4e0bba64c8c861f6047fe6"}
Jul 07 19:10:58.578817 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:58.578507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kz7dk" event={"ID":"b4e13868-6f0d-4d6c-91c0-38c61d4e5e37","Type":"ContainerStarted","Data":"38e9f9157b2ebdbd4eaa52154f558eab7b4e9683631037d2fa7c6b53fc2a9e82"}
Jul 07 19:10:58.609140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:58.609099    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kz7dk" podStartSLOduration=3.385582196 podStartE2EDuration="4.609066809s" totalImagesPullingTime="1.15369574s" totalInitContainerRuntime="69.788873ms" isStatefulPod=true podCreationTimestamp="2026-07-07 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:58.607450149 +0000 UTC m=+103.015933705" watchObservedRunningTime="2026-07-07 19:10:58.609066809 +0000 UTC m=+103.017550365"
Jul 07 19:10:59.464302 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:10:59.464276    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cw4t9"
Jul 07 19:11:25.926200 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:25.926170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:11:25.928440 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:25.928424    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805310a-567e-4e50-825e-f1ee742864ea-metrics-certs\") pod \"network-metrics-daemon-nxctq\" (UID: \"1805310a-567e-4e50-825e-f1ee742864ea\") " pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:11:26.192713 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:26.192656    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqhn7\""
Jul 07 19:11:26.200204 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:26.200183    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxctq"
Jul 07 19:11:26.334183 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:26.334153    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxctq"]
Jul 07 19:11:26.336887 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:11:26.336857    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1805310a_567e_4e50_825e_f1ee742864ea.slice/crio-797d9be62a8bb7c4f7fa95ccc0a82457b46b78ebdd07e0521e4ec4b7fa272efe WatchSource:0}: Error finding container 797d9be62a8bb7c4f7fa95ccc0a82457b46b78ebdd07e0521e4ec4b7fa272efe: Status 404 returned error can't find the container with id 797d9be62a8bb7c4f7fa95ccc0a82457b46b78ebdd07e0521e4ec4b7fa272efe
Jul 07 19:11:26.670799 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:26.670764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxctq" event={"ID":"1805310a-567e-4e50-825e-f1ee742864ea","Type":"ContainerStarted","Data":"797d9be62a8bb7c4f7fa95ccc0a82457b46b78ebdd07e0521e4ec4b7fa272efe"}
Jul 07 19:11:27.676206 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:27.676142    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxctq" event={"ID":"1805310a-567e-4e50-825e-f1ee742864ea","Type":"ContainerStarted","Data":"1b366b9ef9f58266897329b44b91c9e71fb5e656c8f05a8cffa2f6c949484f91"}
Jul 07 19:11:27.676206 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:27.676205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxctq" event={"ID":"1805310a-567e-4e50-825e-f1ee742864ea","Type":"ContainerStarted","Data":"52c029da8ef4334a16588545221515669317023789e629221c2cf9dda2c77dcf"}
Jul 07 19:11:27.699241 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:27.699200    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxctq" podStartSLOduration=129.649776677 podStartE2EDuration="2m10.699184714s" totalImagesPullingTime="1.049408037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:11:27.697489434 +0000 UTC m=+132.105972990" watchObservedRunningTime="2026-07-07 19:11:27.699184714 +0000 UTC m=+132.107668272"
Jul 07 19:11:29.683448 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:29.683408    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa4b7948-1ac4-4255-ba20-85e184fea9cf" containerID="e5c38cb85dd1f968fcb89d1477594eadf615a3ac37620c1a7c62f1d41722cab5" exitCode=0
Jul 07 19:11:29.683884 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:29.683479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26" event={"ID":"aa4b7948-1ac4-4255-ba20-85e184fea9cf","Type":"ContainerDied","Data":"e5c38cb85dd1f968fcb89d1477594eadf615a3ac37620c1a7c62f1d41722cab5"}
Jul 07 19:11:29.683884 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:29.683856    2570 scope.go:117] "RemoveContainer" containerID="e5c38cb85dd1f968fcb89d1477594eadf615a3ac37620c1a7c62f1d41722cab5"
Jul 07 19:11:30.688728 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:11:30.688701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rnv26" event={"ID":"aa4b7948-1ac4-4255-ba20-85e184fea9cf","Type":"ContainerStarted","Data":"611e2961248169d652e2d5fc9076f05e86f0b96c1e0cbaaac98d5e8807504796"}
Jul 07 19:14:10.814844 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.814811    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"]
Jul 07 19:14:10.817317 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.817302    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.820838 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.820801    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:14:10.820988 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.820802    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 19:14:10.820988 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.820893    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nw8gj\""
Jul 07 19:14:10.822820 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.822800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f201db8-b681-4d72-a4b5-a8ec21d58267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.822929 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.822841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf24v\" (UniqueName: \"kubernetes.io/projected/3f201db8-b681-4d72-a4b5-a8ec21d58267-kube-api-access-gf24v\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.835131 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.835106    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"]
Jul 07 19:14:10.923656 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.923622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f201db8-b681-4d72-a4b5-a8ec21d58267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.923656 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.923662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf24v\" (UniqueName: \"kubernetes.io/projected/3f201db8-b681-4d72-a4b5-a8ec21d58267-kube-api-access-gf24v\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.923989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.923971    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f201db8-b681-4d72-a4b5-a8ec21d58267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:10.936037 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:10.936015    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf24v\" (UniqueName: \"kubernetes.io/projected/3f201db8-b681-4d72-a4b5-a8ec21d58267-kube-api-access-gf24v\") pod \"cert-manager-operator-controller-manager-55c444bf86-ttf9c\" (UID: \"3f201db8-b681-4d72-a4b5-a8ec21d58267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:11.125744 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:11.125654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"
Jul 07 19:14:11.265670 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:11.265648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c"]
Jul 07 19:14:11.268526 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:14:11.268494    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f201db8_b681_4d72_a4b5_a8ec21d58267.slice/crio-64c0fb372a1bd6dcc5a37a647ddd2245cae941e1e12416725693b29fb580e464 WatchSource:0}: Error finding container 64c0fb372a1bd6dcc5a37a647ddd2245cae941e1e12416725693b29fb580e464: Status 404 returned error can't find the container with id 64c0fb372a1bd6dcc5a37a647ddd2245cae941e1e12416725693b29fb580e464
Jul 07 19:14:12.207406 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:12.207327    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c" event={"ID":"3f201db8-b681-4d72-a4b5-a8ec21d58267","Type":"ContainerStarted","Data":"64c0fb372a1bd6dcc5a37a647ddd2245cae941e1e12416725693b29fb580e464"}
Jul 07 19:14:14.217102 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:14.217059    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c" event={"ID":"3f201db8-b681-4d72-a4b5-a8ec21d58267","Type":"ContainerStarted","Data":"41fa461f49fb00138d8e0e6643fcbaff27dd1ad58587cfe773765f6c2e5a314e"}
Jul 07 19:14:14.245578 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:14.245443    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ttf9c" podStartSLOduration=1.817799242 podStartE2EDuration="4.245423146s" totalImagesPullingTime="2.427623904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:14.243234473 +0000 UTC m=+298.651718029" watchObservedRunningTime="2026-07-07 19:14:14.245423146 +0000 UTC m=+298.653906703"
Jul 07 19:14:15.991634 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:15.991608    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:14:15.992324 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:15.992306    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:14:15.994550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:15.994530    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:14:15.995257 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:15.995239    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:14:16.001322 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:16.001304    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 19:14:21.314588 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.314546    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4l9j9"]
Jul 07 19:14:21.316887 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.316872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.319816 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.319796    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 19:14:21.319945 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.319905    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 19:14:21.321112 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.321071    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5sxdv\""
Jul 07 19:14:21.329502 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.329480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4l9j9"]
Jul 07 19:14:21.392833 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.392807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.392925 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.392838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqj7\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-kube-api-access-qcqj7\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.493478 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.493444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.493592 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.493496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqj7\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-kube-api-access-qcqj7\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.503830 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.503804    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.503952 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.503935    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqj7\" (UniqueName: \"kubernetes.io/projected/296f3bf5-f9aa-4d6b-9c33-1cdfc8563244-kube-api-access-qcqj7\") pod \"cert-manager-webhook-6486ffd997-4l9j9\" (UID: \"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.626022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.625965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:21.755264 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.755240    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4l9j9"]
Jul 07 19:14:21.757466 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:14:21.757441    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod296f3bf5_f9aa_4d6b_9c33_1cdfc8563244.slice/crio-86b8f5791e32d289abca69d0be5548e48329e2bf5a0a1d369b53828de752282d WatchSource:0}: Error finding container 86b8f5791e32d289abca69d0be5548e48329e2bf5a0a1d369b53828de752282d: Status 404 returned error can't find the container with id 86b8f5791e32d289abca69d0be5548e48329e2bf5a0a1d369b53828de752282d
Jul 07 19:14:21.759359 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:21.759344    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:14:22.251050 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:22.251019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9" event={"ID":"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244","Type":"ContainerStarted","Data":"86b8f5791e32d289abca69d0be5548e48329e2bf5a0a1d369b53828de752282d"}
Jul 07 19:14:25.263635 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:25.263603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9" event={"ID":"296f3bf5-f9aa-4d6b-9c33-1cdfc8563244","Type":"ContainerStarted","Data":"17ced9201e3056a6e1ce01a96f2fa97ae8f38621ccc3fe2d72a587487c6e2cc3"}
Jul 07 19:14:25.263989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:25.263743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:25.282638 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:25.282598    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9" podStartSLOduration=1.816523718 podStartE2EDuration="4.282577467s" totalImagesPullingTime="2.466053749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:25.281838119 +0000 UTC m=+309.690321678" watchObservedRunningTime="2026-07-07 19:14:25.282577467 +0000 UTC m=+309.691061024"
Jul 07 19:14:31.268931 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:31.268899    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4l9j9"
Jul 07 19:14:51.780492 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.780459    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"]
Jul 07 19:14:51.783771 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.783755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:51.786990 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.786961    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 19:14:51.787135 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.787052    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2ttzd\""
Jul 07 19:14:51.787441 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.787426    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 19:14:51.787514 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.787462    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 19:14:51.787686 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.787670    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 19:14:51.803599 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.803573    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"]
Jul 07 19:14:51.911363 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.911323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:51.911363 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.911365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-tmp\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:51.911587 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.911392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwxt5\" (UniqueName: \"kubernetes.io/projected/bdcc172d-4023-4480-a345-bdd579827227-kube-api-access-pwxt5\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:51.911587 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.911480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-manifests\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:51.911587 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:51.911506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-webhook-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.012584 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.012539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwxt5\" (UniqueName: \"kubernetes.io/projected/bdcc172d-4023-4480-a345-bdd579827227-kube-api-access-pwxt5\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.012791 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.012609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-manifests\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.012791 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.012642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-webhook-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.012791 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.012670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.012791 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.012693    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-tmp\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.013072 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.013037    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-manifests\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.015114 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.015061    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdcc172d-4023-4480-a345-bdd579827227-tmp\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.015300 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.015284    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.015339 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.015320    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdcc172d-4023-4480-a345-bdd579827227-webhook-cert\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.029261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.029232    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwxt5\" (UniqueName: \"kubernetes.io/projected/bdcc172d-4023-4480-a345-bdd579827227-kube-api-access-pwxt5\") pod \"opendatahub-operator-controller-manager-75847b84df-48v24\" (UID: \"bdcc172d-4023-4480-a345-bdd579827227\") " pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.094251 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.094221    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:52.239366 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.239334    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"]
Jul 07 19:14:52.241915 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:14:52.241890    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcc172d_4023_4480_a345_bdd579827227.slice/crio-8cfb1145e3b2c70ba28c767f237200be89a6a8d30afa3145f3162f69c535931a WatchSource:0}: Error finding container 8cfb1145e3b2c70ba28c767f237200be89a6a8d30afa3145f3162f69c535931a: Status 404 returned error can't find the container with id 8cfb1145e3b2c70ba28c767f237200be89a6a8d30afa3145f3162f69c535931a
Jul 07 19:14:52.358762 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:52.358668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24" event={"ID":"bdcc172d-4023-4480-a345-bdd579827227","Type":"ContainerStarted","Data":"8cfb1145e3b2c70ba28c767f237200be89a6a8d30afa3145f3162f69c535931a"}
Jul 07 19:14:55.375290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:55.375247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24" event={"ID":"bdcc172d-4023-4480-a345-bdd579827227","Type":"ContainerStarted","Data":"520aeb445b65de7237dd787668f20647e76d8fdd7c9c3e5fea6127ddab4ecc15"}
Jul 07 19:14:56.380198 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:56.380165    2570 generic.go:356] "Generic (PLEG): container finished" podID="bdcc172d-4023-4480-a345-bdd579827227" containerID="520aeb445b65de7237dd787668f20647e76d8fdd7c9c3e5fea6127ddab4ecc15" exitCode=0
Jul 07 19:14:56.380582 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:56.380251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24" event={"ID":"bdcc172d-4023-4480-a345-bdd579827227","Type":"ContainerDied","Data":"520aeb445b65de7237dd787668f20647e76d8fdd7c9c3e5fea6127ddab4ecc15"}
Jul 07 19:14:57.385747 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:57.385707    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24" event={"ID":"bdcc172d-4023-4480-a345-bdd579827227","Type":"ContainerStarted","Data":"ab07ec31fc7ddcf43790ff8bb98219d5cbc6579ff27785c093b15255b534af15"}
Jul 07 19:14:57.386195 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:57.385797    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:14:57.417002 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:14:57.416948    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24" podStartSLOduration=2.128340719 podStartE2EDuration="6.416933062s" totalImagesPullingTime="3.259975648s" totalInitContainerRuntime="1.028616695s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:57.415260279 +0000 UTC m=+341.823743834" watchObservedRunningTime="2026-07-07 19:14:57.416933062 +0000 UTC m=+341.825416619"
Jul 07 19:15:08.391957 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:08.391869    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75847b84df-48v24"
Jul 07 19:15:10.645714 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.645679    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"]
Jul 07 19:15:10.647825 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.647801    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.652565 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.652541    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 19:15:10.657214 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.657193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 19:15:10.657320 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.657200    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mfdtv\""
Jul 07 19:15:10.657320 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.657237    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 19:15:10.657320 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.657257    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 19:15:10.657529 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.657515    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 19:15:10.665991 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.665971    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"]
Jul 07 19:15:10.760930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.760900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-metrics-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.761080 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.760939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gllrw\" (UniqueName: \"kubernetes.io/projected/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-kube-api-access-gllrw\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.761080 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.760959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-manager-config\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.761080 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.761001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.861945 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.861909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-metrics-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.861945 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.861964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gllrw\" (UniqueName: \"kubernetes.io/projected/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-kube-api-access-gllrw\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.862270 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.861991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-manager-config\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.862270 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.862017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.862993 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.862932    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-manager-config\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.864711 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.864691    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-metrics-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.864808 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.864718    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-cert\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.879991 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.879970    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gllrw\" (UniqueName: \"kubernetes.io/projected/90e2a457-45ed-48ac-bdeb-cc24230aaa5b-kube-api-access-gllrw\") pod \"lws-controller-manager-76668d465c-bvrqb\" (UID: \"90e2a457-45ed-48ac-bdeb-cc24230aaa5b\") " pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:10.957282 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:10.957208    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:11.126985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:11.126927    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"]
Jul 07 19:15:11.129286 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:15:11.129256    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e2a457_45ed_48ac_bdeb_cc24230aaa5b.slice/crio-6962138dac5919e01c176ed6a096ec85e55a54b3f5cde1e56bb99f093297549d WatchSource:0}: Error finding container 6962138dac5919e01c176ed6a096ec85e55a54b3f5cde1e56bb99f093297549d: Status 404 returned error can't find the container with id 6962138dac5919e01c176ed6a096ec85e55a54b3f5cde1e56bb99f093297549d
Jul 07 19:15:11.445530 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:11.445487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb" event={"ID":"90e2a457-45ed-48ac-bdeb-cc24230aaa5b","Type":"ContainerStarted","Data":"6962138dac5919e01c176ed6a096ec85e55a54b3f5cde1e56bb99f093297549d"}
Jul 07 19:15:13.455430 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.455390    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pdpq6"]
Jul 07 19:15:13.458124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.458081    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.463464 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.463439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 19:15:13.473514 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.473488    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pdpq6"]
Jul 07 19:15:13.585330 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.585307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-tls-certs\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.585397 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.585356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bfls\" (UniqueName: \"kubernetes.io/projected/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-kube-api-access-5bfls\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.686623 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.686583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-tls-certs\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.686777 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.686660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bfls\" (UniqueName: \"kubernetes.io/projected/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-kube-api-access-5bfls\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.689234 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.689209    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-tls-certs\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.698076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.698052    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bfls\" (UniqueName: \"kubernetes.io/projected/64b3f58d-49ee-4bf7-97e2-e2bd2d55b949-kube-api-access-5bfls\") pod \"model-serving-api-54d89bd5fc-pdpq6\" (UID: \"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949\") " pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.770237 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.770154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:13.905400 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:13.905375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pdpq6"]
Jul 07 19:15:13.906943 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:15:13.906914    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b3f58d_49ee_4bf7_97e2_e2bd2d55b949.slice/crio-eadca773b6142a1410b31e5af47cf7f5a1fc7e0c837ff1b5c0b52a469c90db87 WatchSource:0}: Error finding container eadca773b6142a1410b31e5af47cf7f5a1fc7e0c837ff1b5c0b52a469c90db87: Status 404 returned error can't find the container with id eadca773b6142a1410b31e5af47cf7f5a1fc7e0c837ff1b5c0b52a469c90db87
Jul 07 19:15:14.462748 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:14.462710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb" event={"ID":"90e2a457-45ed-48ac-bdeb-cc24230aaa5b","Type":"ContainerStarted","Data":"629af41294fcc5738e7a7df9409574bb04b4995e8547045249769845ad6cd82c"}
Jul 07 19:15:14.463222 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:14.462778    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:14.464006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:14.463960    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6" event={"ID":"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949","Type":"ContainerStarted","Data":"eadca773b6142a1410b31e5af47cf7f5a1fc7e0c837ff1b5c0b52a469c90db87"}
Jul 07 19:15:14.486502 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:14.486460    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb" podStartSLOduration=2.031557277 podStartE2EDuration="4.486444928s" totalImagesPullingTime="2.454887651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:14.485251352 +0000 UTC m=+358.893734908" watchObservedRunningTime="2026-07-07 19:15:14.486444928 +0000 UTC m=+358.894928546"
Jul 07 19:15:16.480893 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:16.480859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6" event={"ID":"64b3f58d-49ee-4bf7-97e2-e2bd2d55b949","Type":"ContainerStarted","Data":"d35ed0f6fd23d4904d22256077cd62b06e65b23208d2e1a2691561962e1e37bf"}
Jul 07 19:15:16.481290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:16.481012    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:15:16.509048 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:16.508985    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6" podStartSLOduration=1.829679757 podStartE2EDuration="3.508971552s" totalImagesPullingTime="1.679291795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:16.508314652 +0000 UTC m=+360.916798210" watchObservedRunningTime="2026-07-07 19:15:16.508971552 +0000 UTC m=+360.917455109"
Jul 07 19:15:21.091982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.091945    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"]
Jul 07 19:15:21.095485 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.095467    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.098665 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.098644    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 19:15:21.098767 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.098647    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 19:15:21.098767 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.098678    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v82sb\""
Jul 07 19:15:21.098980 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.098965    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 19:15:21.099061 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.098969    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 19:15:21.110216 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.110192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"]
Jul 07 19:15:21.254022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.253988    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45gb2\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-kube-api-access-45gb2\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6622b669-8749-4a35-99d7-3dbb0cd6d93a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.254223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.254186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355322 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355322 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355322 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45gb2\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-kube-api-access-45gb2\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6622b669-8749-4a35-99d7-3dbb0cd6d93a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.355603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.355415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.356444 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.356413    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.357766 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.357736    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.357883 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.357821    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6622b669-8749-4a35-99d7-3dbb0cd6d93a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.357883 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.357833    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.357883 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.357821    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.365678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.365659    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.366005 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.365987    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45gb2\" (UniqueName: \"kubernetes.io/projected/6622b669-8749-4a35-99d7-3dbb0cd6d93a-kube-api-access-45gb2\") pod \"istiod-openshift-gateway-94bb8fbfd-bb29j\" (UID: \"6622b669-8749-4a35-99d7-3dbb0cd6d93a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.404962 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.404940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:21.541745 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:21.541708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"]
Jul 07 19:15:21.544653 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:15:21.544621    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6622b669_8749_4a35_99d7_3dbb0cd6d93a.slice/crio-5b6fb6f5abb70db0237293de235488c639177520481f1352f3c2d7c8a050a185 WatchSource:0}: Error finding container 5b6fb6f5abb70db0237293de235488c639177520481f1352f3c2d7c8a050a185: Status 404 returned error can't find the container with id 5b6fb6f5abb70db0237293de235488c639177520481f1352f3c2d7c8a050a185
Jul 07 19:15:22.507631 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:22.507591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j" event={"ID":"6622b669-8749-4a35-99d7-3dbb0cd6d93a","Type":"ContainerStarted","Data":"5b6fb6f5abb70db0237293de235488c639177520481f1352f3c2d7c8a050a185"}
Jul 07 19:15:23.641896 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:23.641846    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:15:23.642206 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:23.641917    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:15:24.517033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:24.516995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j" event={"ID":"6622b669-8749-4a35-99d7-3dbb0cd6d93a","Type":"ContainerStarted","Data":"3dda56b662629a7e16a72c18ecf63c4b513e9823638ee03cddd890d3869d2ba8"}
Jul 07 19:15:24.517222 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:24.517206    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:24.518672 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:24.518652    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j"
Jul 07 19:15:24.540439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:24.540396    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bb29j" podStartSLOduration=1.4453623389999999 podStartE2EDuration="3.54038164s" totalImagesPullingTime="2.095019301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:24.538692609 +0000 UTC m=+368.947176165" watchObservedRunningTime="2026-07-07 19:15:24.54038164 +0000 UTC m=+368.948865196"
Jul 07 19:15:25.470612 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:25.470577    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76668d465c-bvrqb"
Jul 07 19:15:27.489375 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:15:27.489343    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pdpq6"
Jul 07 19:18:16.478308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.478226    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-d8m86"]
Jul 07 19:18:16.481432 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.481415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.484233 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.484214    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 19:18:16.484336 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.484311    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jsksg\""
Jul 07 19:18:16.493748 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.493728    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d8m86"]
Jul 07 19:18:16.552858 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.552828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/677ab0f9-6e57-4114-bf53-2e63a545dbd3-data\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.552858 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.552858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkkmm\" (UniqueName: \"kubernetes.io/projected/677ab0f9-6e57-4114-bf53-2e63a545dbd3-kube-api-access-qkkmm\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.653346 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.653311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/677ab0f9-6e57-4114-bf53-2e63a545dbd3-data\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.653508 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.653350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkkmm\" (UniqueName: \"kubernetes.io/projected/677ab0f9-6e57-4114-bf53-2e63a545dbd3-kube-api-access-qkkmm\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.653673 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.653653    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/677ab0f9-6e57-4114-bf53-2e63a545dbd3-data\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.664097 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.664059    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkkmm\" (UniqueName: \"kubernetes.io/projected/677ab0f9-6e57-4114-bf53-2e63a545dbd3-kube-api-access-qkkmm\") pod \"postgres-69fb4594cf-d8m86\" (UID: \"677ab0f9-6e57-4114-bf53-2e63a545dbd3\") " pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.791524 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.791451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:16.927143 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:16.927118    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d8m86"]
Jul 07 19:18:16.929477 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:18:16.929448    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677ab0f9_6e57_4114_bf53_2e63a545dbd3.slice/crio-610994491ca2b240aceb899ff9d3c4343c297d63fa1b2bd8217b01ae409da554 WatchSource:0}: Error finding container 610994491ca2b240aceb899ff9d3c4343c297d63fa1b2bd8217b01ae409da554: Status 404 returned error can't find the container with id 610994491ca2b240aceb899ff9d3c4343c297d63fa1b2bd8217b01ae409da554
Jul 07 19:18:17.193788 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:17.193753    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d8m86" event={"ID":"677ab0f9-6e57-4114-bf53-2e63a545dbd3","Type":"ContainerStarted","Data":"610994491ca2b240aceb899ff9d3c4343c297d63fa1b2bd8217b01ae409da554"}
Jul 07 19:18:22.217664 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:22.217574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d8m86" event={"ID":"677ab0f9-6e57-4114-bf53-2e63a545dbd3","Type":"ContainerStarted","Data":"0e80941a7c64dbcf17b899712035800cf28b3bd0cb63a34dfce0a4e3070dec6a"}
Jul 07 19:18:22.217664 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:22.217640    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:22.239094 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:22.239048    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-d8m86" podStartSLOduration=1.308293372 podStartE2EDuration="6.23903319s" totalImagesPullingTime="4.930739818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:22.238191589 +0000 UTC m=+546.646675146" watchObservedRunningTime="2026-07-07 19:18:22.23903319 +0000 UTC m=+546.647516747"
Jul 07 19:18:28.251946 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:28.251911    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-d8m86"
Jul 07 19:18:35.668596 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.668550    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:35.688185 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.688155    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:35.688323 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.688270    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.690065 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.690034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pvf\" (UniqueName: \"kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.690212 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.690099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.690212 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.690176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.691216 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.691199    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 19:18:35.691315 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.691235    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 19:18:35.691315 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.691236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ht7q7\""
Jul 07 19:18:35.790801 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.790769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pvf\" (UniqueName: \"kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.790801 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.790806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.791012 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.790843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.791012 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:18:35.790976    2570 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 19:18:35.791073 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:18:35.791050    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert podName:426a2568-c6eb-4a3b-8d40-4add71734920 nodeName:}" failed. No retries permitted until 2026-07-07 19:18:36.291034149 +0000 UTC m=+560.699517684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert") pod "maas-controller-5574f48f59-h28wk" (UID: "426a2568-c6eb-4a3b-8d40-4add71734920") : secret "maas-controller-webhook-cert" not found
Jul 07 19:18:35.791427 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.791410    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:35.801605 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:35.801581    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pvf\" (UniqueName: \"kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:36.294228 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:36.294199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:36.296797 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:36.296766    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") pod \"maas-controller-5574f48f59-h28wk\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") " pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:36.298512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:36.298497    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:36.433274 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:36.433248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:36.435684 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:18:36.435655    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426a2568_c6eb_4a3b_8d40_4add71734920.slice/crio-eaf7031dc00b105f9daa3d3f930ce4d89151293207fd99a86a0fe481bc18d7ba WatchSource:0}: Error finding container eaf7031dc00b105f9daa3d3f930ce4d89151293207fd99a86a0fe481bc18d7ba: Status 404 returned error can't find the container with id eaf7031dc00b105f9daa3d3f930ce4d89151293207fd99a86a0fe481bc18d7ba
Jul 07 19:18:37.278923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:37.278865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5574f48f59-h28wk" event={"ID":"426a2568-c6eb-4a3b-8d40-4add71734920","Type":"ContainerStarted","Data":"eaf7031dc00b105f9daa3d3f930ce4d89151293207fd99a86a0fe481bc18d7ba"}
Jul 07 19:18:39.289891 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:39.289859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5574f48f59-h28wk" event={"ID":"426a2568-c6eb-4a3b-8d40-4add71734920","Type":"ContainerStarted","Data":"cdc9d96c7860a34ab646e9909fd867d921171ce60df4a06b272fac17129ac09f"}
Jul 07 19:18:39.290278 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:39.289997    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:39.310822 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:39.310768    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5574f48f59-h28wk" podStartSLOduration=2.160083541 podStartE2EDuration="4.310748465s" totalImagesPullingTime="2.150664924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:39.309980163 +0000 UTC m=+563.718463713" watchObservedRunningTime="2026-07-07 19:18:39.310748465 +0000 UTC m=+563.719232023"
Jul 07 19:18:50.155241 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.155206    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:50.155721 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.155435    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5574f48f59-h28wk" podUID="426a2568-c6eb-4a3b-8d40-4add71734920" containerName="manager" containerID="cri-o://cdc9d96c7860a34ab646e9909fd867d921171ce60df4a06b272fac17129ac09f" gracePeriod=30
Jul 07 19:18:50.160218 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.160182    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:50.338960 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.338927    2570 generic.go:356] "Generic (PLEG): container finished" podID="426a2568-c6eb-4a3b-8d40-4add71734920" containerID="cdc9d96c7860a34ab646e9909fd867d921171ce60df4a06b272fac17129ac09f" exitCode=0
Jul 07 19:18:50.339129 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.338998    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5574f48f59-h28wk" event={"ID":"426a2568-c6eb-4a3b-8d40-4add71734920","Type":"ContainerDied","Data":"cdc9d96c7860a34ab646e9909fd867d921171ce60df4a06b272fac17129ac09f"}
Jul 07 19:18:50.401977 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.401953    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:50.505081 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.504994    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9pvf\" (UniqueName: \"kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf\") pod \"426a2568-c6eb-4a3b-8d40-4add71734920\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") "
Jul 07 19:18:50.505081 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.505057    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") pod \"426a2568-c6eb-4a3b-8d40-4add71734920\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") "
Jul 07 19:18:50.505327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.505129    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca\") pod \"426a2568-c6eb-4a3b-8d40-4add71734920\" (UID: \"426a2568-c6eb-4a3b-8d40-4add71734920\") "
Jul 07 19:18:50.505489 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.505457    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca" (OuterVolumeSpecName: "service-ca") pod "426a2568-c6eb-4a3b-8d40-4add71734920" (UID: "426a2568-c6eb-4a3b-8d40-4add71734920"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:50.507340 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.507317    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "426a2568-c6eb-4a3b-8d40-4add71734920" (UID: "426a2568-c6eb-4a3b-8d40-4add71734920"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:50.507451 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.507316    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf" (OuterVolumeSpecName: "kube-api-access-k9pvf") pod "426a2568-c6eb-4a3b-8d40-4add71734920" (UID: "426a2568-c6eb-4a3b-8d40-4add71734920"). InnerVolumeSpecName "kube-api-access-k9pvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:50.606651 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.606613    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/426a2568-c6eb-4a3b-8d40-4add71734920-webhook-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:18:50.606651 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.606644    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426a2568-c6eb-4a3b-8d40-4add71734920-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:18:50.606651 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:50.606652    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9pvf\" (UniqueName: \"kubernetes.io/projected/426a2568-c6eb-4a3b-8d40-4add71734920-kube-api-access-k9pvf\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:18:51.344004 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:51.343969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5574f48f59-h28wk" event={"ID":"426a2568-c6eb-4a3b-8d40-4add71734920","Type":"ContainerDied","Data":"eaf7031dc00b105f9daa3d3f930ce4d89151293207fd99a86a0fe481bc18d7ba"}
Jul 07 19:18:51.344004 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:51.344005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5574f48f59-h28wk"
Jul 07 19:18:51.344511 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:51.344040    2570 scope.go:117] "RemoveContainer" containerID="cdc9d96c7860a34ab646e9909fd867d921171ce60df4a06b272fac17129ac09f"
Jul 07 19:18:51.369310 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:51.369284    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:51.375173 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:51.375152    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5574f48f59-h28wk"]
Jul 07 19:18:52.176606 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:18:52.176570    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426a2568-c6eb-4a3b-8d40-4add71734920" path="/var/lib/kubelet/pods/426a2568-c6eb-4a3b-8d40-4add71734920/volumes"
Jul 07 19:19:11.772880 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.772841    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9rvwr"]
Jul 07 19:19:11.773357 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.773130    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426a2568-c6eb-4a3b-8d40-4add71734920" containerName="manager"
Jul 07 19:19:11.773357 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.773141    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="426a2568-c6eb-4a3b-8d40-4add71734920" containerName="manager"
Jul 07 19:19:11.773357 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.773197    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="426a2568-c6eb-4a3b-8d40-4add71734920" containerName="manager"
Jul 07 19:19:11.775315 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.775300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.778114 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.778076    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 19:19:11.778261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.778118    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-64h7f\""
Jul 07 19:19:11.786029 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.786003    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9rvwr"]
Jul 07 19:19:11.856184 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.856146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee030528-7971-4129-a073-3d4c1f95d1e9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.856184 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.856186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcv4p\" (UniqueName: \"kubernetes.io/projected/ee030528-7971-4129-a073-3d4c1f95d1e9-kube-api-access-hcv4p\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.957576 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.957540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee030528-7971-4129-a073-3d4c1f95d1e9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.957776 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.957585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcv4p\" (UniqueName: \"kubernetes.io/projected/ee030528-7971-4129-a073-3d4c1f95d1e9-kube-api-access-hcv4p\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.958316 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.958293    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee030528-7971-4129-a073-3d4c1f95d1e9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:11.971124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:11.971076    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcv4p\" (UniqueName: \"kubernetes.io/projected/ee030528-7971-4129-a073-3d4c1f95d1e9-kube-api-access-hcv4p\") pod \"payload-pre-processing-7964457696-9rvwr\" (UID: \"ee030528-7971-4129-a073-3d4c1f95d1e9\") " pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:12.085617 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:12.085576    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:12.215184 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:12.215154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9rvwr"]
Jul 07 19:19:12.218230 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:19:12.218203    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee030528_7971_4129_a073_3d4c1f95d1e9.slice/crio-9c939a3d8a2d8c017444adcfe8b68a5e191fe3696b45585ef8fde3960b2ec8e9 WatchSource:0}: Error finding container 9c939a3d8a2d8c017444adcfe8b68a5e191fe3696b45585ef8fde3960b2ec8e9: Status 404 returned error can't find the container with id 9c939a3d8a2d8c017444adcfe8b68a5e191fe3696b45585ef8fde3960b2ec8e9
Jul 07 19:19:12.429159 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:12.429065    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr" event={"ID":"ee030528-7971-4129-a073-3d4c1f95d1e9","Type":"ContainerStarted","Data":"9c939a3d8a2d8c017444adcfe8b68a5e191fe3696b45585ef8fde3960b2ec8e9"}
Jul 07 19:19:14.439407 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:14.439375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr" event={"ID":"ee030528-7971-4129-a073-3d4c1f95d1e9","Type":"ContainerStarted","Data":"d3d2c6274a57f978b1ccb867fc8e5ee0fe193e0f3c57f37d0e060f62a683c6ae"}
Jul 07 19:19:14.439756 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:14.439443    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:14.461489 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:14.461444    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr" podStartSLOduration=1.978449229 podStartE2EDuration="3.461428752s" totalImagesPullingTime="1.482979523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:14.459914445 +0000 UTC m=+598.868398002" watchObservedRunningTime="2026-07-07 19:19:14.461428752 +0000 UTC m=+598.869912344"
Jul 07 19:19:16.021431 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:16.021400    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:19:16.021856 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:16.021528    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:19:16.024125 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:16.024105    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:19:16.024243 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:16.024110    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:19:25.445165 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:25.445133    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-9rvwr"
Jul 07 19:19:44.015685 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.015616    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"]
Jul 07 19:19:44.017756 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.017739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.020771 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.020752    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 19:19:44.020875 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.020809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 19:19:44.022075 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.022035    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l9d5q\""
Jul 07 19:19:44.022075 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.022044    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 19:19:44.034345 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.031132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"]
Jul 07 19:19:44.202241 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202217    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.202392 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da38064c-b6cb-45af-84a8-d7fd468c8514-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.202392 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202269    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xqf\" (UniqueName: \"kubernetes.io/projected/da38064c-b6cb-45af-84a8-d7fd468c8514-kube-api-access-v4xqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.202392 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202353    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.202522 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.202522 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.202417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303181 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da38064c-b6cb-45af-84a8-d7fd468c8514-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xqf\" (UniqueName: \"kubernetes.io/projected/da38064c-b6cb-45af-84a8-d7fd468c8514-kube-api-access-v4xqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303674 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303648    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303778 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303719    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.303778 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.303749    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.305542 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.305518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da38064c-b6cb-45af-84a8-d7fd468c8514-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.305920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.305897    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da38064c-b6cb-45af-84a8-d7fd468c8514-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.313248 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.313225    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xqf\" (UniqueName: \"kubernetes.io/projected/da38064c-b6cb-45af-84a8-d7fd468c8514-kube-api-access-v4xqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cmcvh\" (UID: \"da38064c-b6cb-45af-84a8-d7fd468c8514\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.328115 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.328079    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:44.458227 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.458038    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"]
Jul 07 19:19:44.460919 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:19:44.460895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda38064c_b6cb_45af_84a8_d7fd468c8514.slice/crio-c402cf99caceaaf31c0ee6dad136cfbc45407c70cb41f2c57c79ca934129ec79 WatchSource:0}: Error finding container c402cf99caceaaf31c0ee6dad136cfbc45407c70cb41f2c57c79ca934129ec79: Status 404 returned error can't find the container with id c402cf99caceaaf31c0ee6dad136cfbc45407c70cb41f2c57c79ca934129ec79
Jul 07 19:19:44.462262 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.462243    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:19:44.568358 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:44.568300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh" event={"ID":"da38064c-b6cb-45af-84a8-d7fd468c8514","Type":"ContainerStarted","Data":"c402cf99caceaaf31c0ee6dad136cfbc45407c70cb41f2c57c79ca934129ec79"}
Jul 07 19:19:45.573653 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:45.573621    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh" event={"ID":"da38064c-b6cb-45af-84a8-d7fd468c8514","Type":"ContainerStarted","Data":"75ad6ac8cc0c06fb7273fb5e1ff43054936f923259248d7715c061e69bdf7fb9"}
Jul 07 19:19:45.594931 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:45.594885    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh" podStartSLOduration=1.59448959 podStartE2EDuration="2.594869447s" totalImagesPullingTime="1.000379857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:45.593838261 +0000 UTC m=+630.002321817" watchObservedRunningTime="2026-07-07 19:19:45.594869447 +0000 UTC m=+630.003353045"
Jul 07 19:19:54.328875 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:54.328843    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:54.329313 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:54.329137    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:54.341550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:54.341531    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:54.628777 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:54.628702    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cmcvh"
Jul 07 19:19:58.310967 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.310935    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"]
Jul 07 19:19:58.313321 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.313300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.315977 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.315955    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 19:19:58.326289 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.326269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"]
Jul 07 19:19:58.413047 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.413187 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.413187 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.413187 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.413187 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rls8c\" (UniqueName: \"kubernetes.io/projected/2a7ab379-3b6e-4981-a038-1b371d58d8bf-kube-api-access-rls8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.413359 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.413234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rls8c\" (UniqueName: \"kubernetes.io/projected/2a7ab379-3b6e-4981-a038-1b371d58d8bf-kube-api-access-rls8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514709 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514767    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514855 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514838    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.514962 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.514944    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.516743 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.516726    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a7ab379-3b6e-4981-a038-1b371d58d8bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.517150 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.517131    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a7ab379-3b6e-4981-a038-1b371d58d8bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.524437 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.524416    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rls8c\" (UniqueName: \"kubernetes.io/projected/2a7ab379-3b6e-4981-a038-1b371d58d8bf-kube-api-access-rls8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764\" (UID: \"2a7ab379-3b6e-4981-a038-1b371d58d8bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.622950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.622895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:19:58.762783 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:58.762602    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"]
Jul 07 19:19:58.765385 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:19:58.765363    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7ab379_3b6e_4981_a038_1b371d58d8bf.slice/crio-6e8995a2b8b6a32fb4d1bda1bf58ec3162c892f5fe33f4b10497282120881904 WatchSource:0}: Error finding container 6e8995a2b8b6a32fb4d1bda1bf58ec3162c892f5fe33f4b10497282120881904: Status 404 returned error can't find the container with id 6e8995a2b8b6a32fb4d1bda1bf58ec3162c892f5fe33f4b10497282120881904
Jul 07 19:19:59.639163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:59.639127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764" event={"ID":"2a7ab379-3b6e-4981-a038-1b371d58d8bf","Type":"ContainerStarted","Data":"6b242b9353577535cb49f6dd799f44265f5600a185ce0152a8418278a3f2b90a"}
Jul 07 19:19:59.639546 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:59.639219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764" event={"ID":"2a7ab379-3b6e-4981-a038-1b371d58d8bf","Type":"ContainerStarted","Data":"6e8995a2b8b6a32fb4d1bda1bf58ec3162c892f5fe33f4b10497282120881904"}
Jul 07 19:19:59.663257 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:19:59.663211    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764" podStartSLOduration=1.495202344 podStartE2EDuration="1.663197405s" totalImagesPullingTime="167.995061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:59.663121525 +0000 UTC m=+644.071605083" watchObservedRunningTime="2026-07-07 19:19:59.663197405 +0000 UTC m=+644.071680962"
Jul 07 19:20:08.623276 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:20:08.623237    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:20:08.623701 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:20:08.623305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:20:08.635345 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:20:08.635321    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:20:08.688820 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:20:08.688800    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764"
Jul 07 19:23:20.177504 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.177472    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6847f4bd59-4zdhk"]
Jul 07 19:23:20.179627 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.179612    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.183500 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.183473    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 19:23:20.183641 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.183505    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ht7q7\""
Jul 07 19:23:20.183641 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.183479    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 19:23:20.190578 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.190548    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6847f4bd59-4zdhk"]
Jul 07 19:23:20.295179 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.295156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1eb834a9-dde8-430a-a924-6a18e6f04faa-webhook-cert\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.295274 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.295188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7dg\" (UniqueName: \"kubernetes.io/projected/1eb834a9-dde8-430a-a924-6a18e6f04faa-kube-api-access-6l7dg\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.295274 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.295207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb834a9-dde8-430a-a924-6a18e6f04faa-service-ca\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.395922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.395900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1eb834a9-dde8-430a-a924-6a18e6f04faa-webhook-cert\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.396007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.395928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7dg\" (UniqueName: \"kubernetes.io/projected/1eb834a9-dde8-430a-a924-6a18e6f04faa-kube-api-access-6l7dg\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.396007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.395950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb834a9-dde8-430a-a924-6a18e6f04faa-service-ca\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.396529 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.396483    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eb834a9-dde8-430a-a924-6a18e6f04faa-service-ca\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.398245 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.398226    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1eb834a9-dde8-430a-a924-6a18e6f04faa-webhook-cert\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.408548 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.408526    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7dg\" (UniqueName: \"kubernetes.io/projected/1eb834a9-dde8-430a-a924-6a18e6f04faa-kube-api-access-6l7dg\") pod \"maas-controller-6847f4bd59-4zdhk\" (UID: \"1eb834a9-dde8-430a-a924-6a18e6f04faa\") " pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.489682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.489633    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:20.616119 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:20.616076    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6847f4bd59-4zdhk"]
Jul 07 19:23:20.617966 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:23:20.617943    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb834a9_dde8_430a_a924_6a18e6f04faa.slice/crio-afabafb477fecffdcfc340884c42a7019baf0e6aea5c5bff025feb9908013e4b WatchSource:0}: Error finding container afabafb477fecffdcfc340884c42a7019baf0e6aea5c5bff025feb9908013e4b: Status 404 returned error can't find the container with id afabafb477fecffdcfc340884c42a7019baf0e6aea5c5bff025feb9908013e4b
Jul 07 19:23:21.463366 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:21.463329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6847f4bd59-4zdhk" event={"ID":"1eb834a9-dde8-430a-a924-6a18e6f04faa","Type":"ContainerStarted","Data":"4e468548e211c13a055e47d2e08be3839b99e961085bba8c2cc3c5d30c11f1b3"}
Jul 07 19:23:21.463775 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:21.463383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6847f4bd59-4zdhk" event={"ID":"1eb834a9-dde8-430a-a924-6a18e6f04faa","Type":"ContainerStarted","Data":"afabafb477fecffdcfc340884c42a7019baf0e6aea5c5bff025feb9908013e4b"}
Jul 07 19:23:21.463775 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:21.463469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:23:21.491079 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:21.491034    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6847f4bd59-4zdhk" podStartSLOduration=1.131743854 podStartE2EDuration="1.49102101s" totalImagesPullingTime="359.277156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:21.488917824 +0000 UTC m=+845.897401379" watchObservedRunningTime="2026-07-07 19:23:21.49102101 +0000 UTC m=+845.899504565"
Jul 07 19:23:32.472916 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:23:32.472889    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6847f4bd59-4zdhk"
Jul 07 19:24:16.045022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:24:16.044941    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:24:16.045926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:24:16.045902    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:24:16.048118 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:24:16.048077    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:24:16.048989 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:24:16.048969    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:29:16.068114 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:29:16.068067    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:29:16.070649 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:29:16.070629    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:29:16.071223 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:29:16.071208    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:29:16.073725 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:29:16.073707    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:34:16.092571 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:34:16.092537    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:34:16.095801 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:34:16.095779    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:34:16.095940 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:34:16.095908    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:34:16.099213 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:34:16.099193    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:35:46.055985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.055955    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:46.059079 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.059054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.062019 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.061994    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:35:46.062019 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.062005    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-b0e1e8b0-serving-cert\""
Jul 07 19:35:46.070105 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.070071    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:46.075471 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.075445    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.075583 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.075564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.075630 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.075616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.176301 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.176280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.176449 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.176326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.176449 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.176349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.176864 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.176847    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.178688 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.178670    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.186803 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.186779    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v\") pod \"maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") " pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.369079 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.368997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:46.504135 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.504109    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:46.506603 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:35:46.506573    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbeabdb_06e0_4e9f_b9a4_b240172d4d58.slice/crio-86a8096a7953b944350051469a517563e6039ac98139d6a34bf72216d8828c7f WatchSource:0}: Error finding container 86a8096a7953b944350051469a517563e6039ac98139d6a34bf72216d8828c7f: Status 404 returned error can't find the container with id 86a8096a7953b944350051469a517563e6039ac98139d6a34bf72216d8828c7f
Jul 07 19:35:46.508305 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.508284    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:35:46.513851 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:46.513824    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" event={"ID":"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58","Type":"ContainerStarted","Data":"86a8096a7953b944350051469a517563e6039ac98139d6a34bf72216d8828c7f"}
Jul 07 19:35:49.527870 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:49.527838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" event={"ID":"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58","Type":"ContainerStarted","Data":"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"}
Jul 07 19:35:49.528266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:49.527943    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:49.558625 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:49.558578    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" podStartSLOduration=1.579204649 podStartE2EDuration="3.558563863s" totalImagesPullingTime="1.979359214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:35:49.557375999 +0000 UTC m=+1593.965859559" watchObservedRunningTime="2026-07-07 19:35:49.558563863 +0000 UTC m=+1593.967047420"
Jul 07 19:35:53.825180 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:53.825151    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:53.825639 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:53.825320    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" podUID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" containerName="maas-api" containerID="cri-o://3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6" gracePeriod=30
Jul 07 19:35:53.830897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:53.830873    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:54.074383 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.074360    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:54.138841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.138769    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls\") pod \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") "
Jul 07 19:35:54.138962 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.138847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v\") pod \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") "
Jul 07 19:35:54.138962 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.138939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca\") pod \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\" (UID: \"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58\") "
Jul 07 19:35:54.139313 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.139294    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" (UID: "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:35:54.141060 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.141040    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v" (OuterVolumeSpecName: "kube-api-access-sv76v") pod "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" (UID: "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58"). InnerVolumeSpecName "kube-api-access-sv76v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:35:54.141118 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.141058    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" (UID: "9bbeabdb-06e0-4e9f-b9a4-b240172d4d58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:35:54.239787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.239763    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:35:54.239787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.239783    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:35:54.239787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.239791    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv76v\" (UniqueName: \"kubernetes.io/projected/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58-kube-api-access-sv76v\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:35:54.549610 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.549578    2570 generic.go:356] "Generic (PLEG): container finished" podID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" containerID="3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6" exitCode=0
Jul 07 19:35:54.549755 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.549625    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"
Jul 07 19:35:54.549755 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.549648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" event={"ID":"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58","Type":"ContainerDied","Data":"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"}
Jul 07 19:35:54.549755 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.549701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw" event={"ID":"9bbeabdb-06e0-4e9f-b9a4-b240172d4d58","Type":"ContainerDied","Data":"86a8096a7953b944350051469a517563e6039ac98139d6a34bf72216d8828c7f"}
Jul 07 19:35:54.549755 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.549726    2570 scope.go:117] "RemoveContainer" containerID="3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"
Jul 07 19:35:54.557803 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.557788    2570 scope.go:117] "RemoveContainer" containerID="3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"
Jul 07 19:35:54.558071 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:35:54.558052    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6\": container with ID starting with 3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6 not found: ID does not exist" containerID="3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"
Jul 07 19:35:54.558144 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.558079    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6"} err="failed to get container status \"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6\": rpc error: code = NotFound desc = could not find container \"3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6\": container with ID starting with 3d5d387a7338a8212a7e1ff0cba2aad18177aa63d9e514d7caf9c81412dff2d6 not found: ID does not exist"
Jul 07 19:35:54.569843 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.569823    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:54.574659 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:54.574639    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-b0e1e8b0-7b6b85db6c-9mnrw"]
Jul 07 19:35:56.177455 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:35:56.177421    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" path="/var/lib/kubelet/pods/9bbeabdb-06e0-4e9f-b9a4-b240172d4d58/volumes"
Jul 07 19:36:18.914639 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.914602    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:18.915066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.914911    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" containerName="maas-api"
Jul 07 19:36:18.915066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.914922    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" containerName="maas-api"
Jul 07 19:36:18.915066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.914977    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbeabdb-06e0-4e9f-b9a4-b240172d4d58" containerName="maas-api"
Jul 07 19:36:18.918778 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.918757    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:18.921975 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.921952    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-c5483003-serving-cert\""
Jul 07 19:36:18.922194 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.922181    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:36:18.929068 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:18.929047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:19.033820 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.033790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.033963 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.033862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.033963 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.033907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhg2x\" (UniqueName: \"kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.134625 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.134593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.134785 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.134652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhg2x\" (UniqueName: \"kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.134785 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.134686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.135438 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.135415    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.137294 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.137274    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.144324 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.144301    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhg2x\" (UniqueName: \"kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x\") pod \"maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") " pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.229510 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.229446    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:19.383643 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.383615    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:19.388154 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:36:19.388125    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5cc29e7_0d7b_4546_b4a1_1c8f2d666e32.slice/crio-b7eb8f1c8deeac604dc92083184b6837998d54a025f4d71b674810a5960c2a6d WatchSource:0}: Error finding container b7eb8f1c8deeac604dc92083184b6837998d54a025f4d71b674810a5960c2a6d: Status 404 returned error can't find the container with id b7eb8f1c8deeac604dc92083184b6837998d54a025f4d71b674810a5960c2a6d
Jul 07 19:36:19.654266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:19.654232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" event={"ID":"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32","Type":"ContainerStarted","Data":"b7eb8f1c8deeac604dc92083184b6837998d54a025f4d71b674810a5960c2a6d"}
Jul 07 19:36:20.661245 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:20.661213    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" event={"ID":"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32","Type":"ContainerStarted","Data":"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"}
Jul 07 19:36:20.661624 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:20.661279    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:20.682042 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:20.681994    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" podStartSLOduration=2.341196276 podStartE2EDuration="2.681978356s" totalImagesPullingTime="340.78208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:36:20.681819828 +0000 UTC m=+1625.090303385" watchObservedRunningTime="2026-07-07 19:36:20.681978356 +0000 UTC m=+1625.090461911"
Jul 07 19:36:26.203628 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.203594    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:26.204013 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.203763    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" podUID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" containerName="maas-api" containerID="cri-o://53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2" gracePeriod=30
Jul 07 19:36:26.208869 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.208847    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:26.453253 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.453225    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:26.598531 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.598502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls\") pod \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") "
Jul 07 19:36:26.598682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.598546    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhg2x\" (UniqueName: \"kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x\") pod \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") "
Jul 07 19:36:26.598682 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.598626    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca\") pod \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\" (UID: \"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32\") "
Jul 07 19:36:26.599012 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.598990    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" (UID: "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:36:26.600765 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.600741    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" (UID: "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:36:26.600765 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.600747    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x" (OuterVolumeSpecName: "kube-api-access-lhg2x") pod "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" (UID: "d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32"). InnerVolumeSpecName "kube-api-access-lhg2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:36:26.688376 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.688347    2570 generic.go:356] "Generic (PLEG): container finished" podID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" containerID="53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2" exitCode=0
Jul 07 19:36:26.688486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.688391    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"
Jul 07 19:36:26.688486 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.688438    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" event={"ID":"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32","Type":"ContainerDied","Data":"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"}
Jul 07 19:36:26.688554 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.688491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj" event={"ID":"d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32","Type":"ContainerDied","Data":"b7eb8f1c8deeac604dc92083184b6837998d54a025f4d71b674810a5960c2a6d"}
Jul 07 19:36:26.688554 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.688519    2570 scope.go:117] "RemoveContainer" containerID="53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"
Jul 07 19:36:26.696780 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.696766    2570 scope.go:117] "RemoveContainer" containerID="53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"
Jul 07 19:36:26.697007 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:36:26.696984    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2\": container with ID starting with 53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2 not found: ID does not exist" containerID="53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"
Jul 07 19:36:26.697111 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.697013    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2"} err="failed to get container status \"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2\": rpc error: code = NotFound desc = could not find container \"53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2\": container with ID starting with 53807c43478fd3fa22e07ddc640a99d6cd1183598b102a4a2c5fe289d439a3f2 not found: ID does not exist"
Jul 07 19:36:26.699377 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.699362    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhg2x\" (UniqueName: \"kubernetes.io/projected/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-kube-api-access-lhg2x\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:36:26.699426 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.699381    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:36:26.699426 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.699390    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:36:26.711689 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.711666    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:26.714116 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:26.714072    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-c5483003-7d8cfbbcbc-n8wvj"]
Jul 07 19:36:28.176442 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:36:28.176411    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" path="/var/lib/kubelet/pods/d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32/volumes"
Jul 07 19:38:14.572580 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.572547    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:14.573054 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.572948    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" containerName="maas-api"
Jul 07 19:38:14.573054 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.572964    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" containerName="maas-api"
Jul 07 19:38:14.573054 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.573040    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5cc29e7-0d7b-4546-b4a1-1c8f2d666e32" containerName="maas-api"
Jul 07 19:38:14.576118 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.576075    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.579176 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.579159    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-67a065b1-serving-cert\""
Jul 07 19:38:14.579278 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.579163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:38:14.587343 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.587323    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:14.763408 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.763380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.763565 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.763411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjzjx\" (UniqueName: \"kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.763565 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.763460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.864738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.864670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.864738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.864726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.864892 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.864744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjzjx\" (UniqueName: \"kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.865309 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.865285    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.867151 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.867130    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.878381 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.878362    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjzjx\" (UniqueName: \"kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx\") pod \"maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") " pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:14.886217 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:14.886199    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:15.019678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:15.019643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:15.141489 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:15.141422    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" event={"ID":"9fc30fb5-de13-4ca4-83ed-073eac85438e","Type":"ContainerStarted","Data":"bfab46844fded5b1f7dce6b5ebd710db18bc38b4181bfdc73bd710dc5f97ce81"}
Jul 07 19:38:16.146963 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:16.146930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" event={"ID":"9fc30fb5-de13-4ca4-83ed-073eac85438e","Type":"ContainerStarted","Data":"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"}
Jul 07 19:38:16.147393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:16.147024    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:16.166499 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:16.166407    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" podStartSLOduration=1.536956799 podStartE2EDuration="2.166391311s" totalImagesPullingTime="629.434512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:38:16.166187139 +0000 UTC m=+1740.574670695" watchObservedRunningTime="2026-07-07 19:38:16.166391311 +0000 UTC m=+1740.574874867"
Jul 07 19:38:22.156014 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:22.155985    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:27.423308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.423276    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:27.424112 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.424065    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" podUID="9fc30fb5-de13-4ca4-83ed-073eac85438e" containerName="maas-api" containerID="cri-o://fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898" gracePeriod=30
Jul 07 19:38:27.671935 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.671910    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:27.748382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.748309    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjzjx\" (UniqueName: \"kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx\") pod \"9fc30fb5-de13-4ca4-83ed-073eac85438e\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") "
Jul 07 19:38:27.748382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.748348    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls\") pod \"9fc30fb5-de13-4ca4-83ed-073eac85438e\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") "
Jul 07 19:38:27.748562 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.748382    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca\") pod \"9fc30fb5-de13-4ca4-83ed-073eac85438e\" (UID: \"9fc30fb5-de13-4ca4-83ed-073eac85438e\") "
Jul 07 19:38:27.748773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.748749    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fc30fb5-de13-4ca4-83ed-073eac85438e" (UID: "9fc30fb5-de13-4ca4-83ed-073eac85438e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:38:27.750405 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.750379    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fc30fb5-de13-4ca4-83ed-073eac85438e" (UID: "9fc30fb5-de13-4ca4-83ed-073eac85438e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:38:27.750503 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.750419    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx" (OuterVolumeSpecName: "kube-api-access-fjzjx") pod "9fc30fb5-de13-4ca4-83ed-073eac85438e" (UID: "9fc30fb5-de13-4ca4-83ed-073eac85438e"). InnerVolumeSpecName "kube-api-access-fjzjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:38:27.849124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.849079    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fc30fb5-de13-4ca4-83ed-073eac85438e-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:38:27.849124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.849119    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fc30fb5-de13-4ca4-83ed-073eac85438e-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:38:27.849124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:27.849128    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjzjx\" (UniqueName: \"kubernetes.io/projected/9fc30fb5-de13-4ca4-83ed-073eac85438e-kube-api-access-fjzjx\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:38:28.194632 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.194602    2570 generic.go:356] "Generic (PLEG): container finished" podID="9fc30fb5-de13-4ca4-83ed-073eac85438e" containerID="fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898" exitCode=0
Jul 07 19:38:28.194735 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.194647    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"
Jul 07 19:38:28.194735 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.194674    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" event={"ID":"9fc30fb5-de13-4ca4-83ed-073eac85438e","Type":"ContainerDied","Data":"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"}
Jul 07 19:38:28.194735 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.194717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7" event={"ID":"9fc30fb5-de13-4ca4-83ed-073eac85438e","Type":"ContainerDied","Data":"bfab46844fded5b1f7dce6b5ebd710db18bc38b4181bfdc73bd710dc5f97ce81"}
Jul 07 19:38:28.194829 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.194738    2570 scope.go:117] "RemoveContainer" containerID="fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"
Jul 07 19:38:28.202612 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.202595    2570 scope.go:117] "RemoveContainer" containerID="fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"
Jul 07 19:38:28.202830 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:38:28.202815    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898\": container with ID starting with fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898 not found: ID does not exist" containerID="fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"
Jul 07 19:38:28.202871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.202838    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898"} err="failed to get container status \"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898\": rpc error: code = NotFound desc = could not find container \"fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898\": container with ID starting with fafc7ba2df560c87618a6639dc0b45ae7becdf471704de8e1d4e4d03dd013898 not found: ID does not exist"
Jul 07 19:38:28.215151 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.215132    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:28.219715 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:28.219696    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-67a065b1-6f69bd4449-lz4s7"]
Jul 07 19:38:30.176341 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:30.176307    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc30fb5-de13-4ca4-83ed-073eac85438e" path="/var/lib/kubelet/pods/9fc30fb5-de13-4ca4-83ed-073eac85438e/volumes"
Jul 07 19:38:58.588227 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.588193    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:38:58.588773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.588628    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc30fb5-de13-4ca4-83ed-073eac85438e" containerName="maas-api"
Jul 07 19:38:58.588773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.588646    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc30fb5-de13-4ca4-83ed-073eac85438e" containerName="maas-api"
Jul 07 19:38:58.588773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.588731    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc30fb5-de13-4ca4-83ed-073eac85438e" containerName="maas-api"
Jul 07 19:38:58.591752 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.591732    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.596823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.596799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-6fe61d50-serving-cert\""
Jul 07 19:38:58.597172 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.597156    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:38:58.620541 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.620519    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:38:58.678118 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.678065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.678334 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.678126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.678334 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.678247    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwcpm\" (UniqueName: \"kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.779284 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.779256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.779284 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.779287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.779464 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.779350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwcpm\" (UniqueName: \"kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.780111 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.780061    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.781765 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.781745    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.790526 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.790505    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwcpm\" (UniqueName: \"kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm\") pod \"maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") " pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:58.901355 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:58.901302    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:38:59.038664 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:59.038641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:38:59.040920 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:38:59.040895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dea0922_486e_40e0_b545_f3b8a599742a.slice/crio-9694b8912c06da18c04bd4309593941f5992c1625c547df8de30b4a857292422 WatchSource:0}: Error finding container 9694b8912c06da18c04bd4309593941f5992c1625c547df8de30b4a857292422: Status 404 returned error can't find the container with id 9694b8912c06da18c04bd4309593941f5992c1625c547df8de30b4a857292422
Jul 07 19:38:59.321425 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:38:59.321395    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" event={"ID":"6dea0922-486e-40e0-b545-f3b8a599742a","Type":"ContainerStarted","Data":"9694b8912c06da18c04bd4309593941f5992c1625c547df8de30b4a857292422"}
Jul 07 19:39:00.326353 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:00.326319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" event={"ID":"6dea0922-486e-40e0-b545-f3b8a599742a","Type":"ContainerStarted","Data":"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"}
Jul 07 19:39:00.326750 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:00.326442    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:39:00.348383 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:00.348345    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" podStartSLOduration=1.582717731 podStartE2EDuration="2.348331425s" totalImagesPullingTime="765.613694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:39:00.347736092 +0000 UTC m=+1784.756219650" watchObservedRunningTime="2026-07-07 19:39:00.348331425 +0000 UTC m=+1784.756814981"
Jul 07 19:39:06.335456 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:06.335426    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:39:16.117251 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:16.117221    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:39:16.120440 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:16.120412    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:39:16.124260 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:16.124239    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:39:16.127006 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:16.126988    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:39:40.890278 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:40.890240    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:39:40.890826 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:40.890509    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" podUID="6dea0922-486e-40e0-b545-f3b8a599742a" containerName="maas-api" containerID="cri-o://08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee" gracePeriod=30
Jul 07 19:39:41.127650 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.127626    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:39:41.288199 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.288133    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls\") pod \"6dea0922-486e-40e0-b545-f3b8a599742a\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") "
Jul 07 19:39:41.288199 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.288163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwcpm\" (UniqueName: \"kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm\") pod \"6dea0922-486e-40e0-b545-f3b8a599742a\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") "
Jul 07 19:39:41.288199 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.288189    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca\") pod \"6dea0922-486e-40e0-b545-f3b8a599742a\" (UID: \"6dea0922-486e-40e0-b545-f3b8a599742a\") "
Jul 07 19:39:41.288551 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.288520    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6dea0922-486e-40e0-b545-f3b8a599742a" (UID: "6dea0922-486e-40e0-b545-f3b8a599742a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:39:41.290304 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.290274    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6dea0922-486e-40e0-b545-f3b8a599742a" (UID: "6dea0922-486e-40e0-b545-f3b8a599742a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:39:41.290389 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.290341    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm" (OuterVolumeSpecName: "kube-api-access-bwcpm") pod "6dea0922-486e-40e0-b545-f3b8a599742a" (UID: "6dea0922-486e-40e0-b545-f3b8a599742a"). InnerVolumeSpecName "kube-api-access-bwcpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:39:41.389018 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.388995    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dea0922-486e-40e0-b545-f3b8a599742a-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:39:41.389018 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.389015    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwcpm\" (UniqueName: \"kubernetes.io/projected/6dea0922-486e-40e0-b545-f3b8a599742a-kube-api-access-bwcpm\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:39:41.389158 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.389024    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dea0922-486e-40e0-b545-f3b8a599742a-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:39:41.490240 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.490212    2570 generic.go:356] "Generic (PLEG): container finished" podID="6dea0922-486e-40e0-b545-f3b8a599742a" containerID="08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee" exitCode=0
Jul 07 19:39:41.490354 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.490255    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"
Jul 07 19:39:41.490354 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.490300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" event={"ID":"6dea0922-486e-40e0-b545-f3b8a599742a","Type":"ContainerDied","Data":"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"}
Jul 07 19:39:41.490354 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.490342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf" event={"ID":"6dea0922-486e-40e0-b545-f3b8a599742a","Type":"ContainerDied","Data":"9694b8912c06da18c04bd4309593941f5992c1625c547df8de30b4a857292422"}
Jul 07 19:39:41.490460 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.490371    2570 scope.go:117] "RemoveContainer" containerID="08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"
Jul 07 19:39:41.499170 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.499145    2570 scope.go:117] "RemoveContainer" containerID="08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"
Jul 07 19:39:41.499401 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:39:41.499383    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee\": container with ID starting with 08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee not found: ID does not exist" containerID="08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"
Jul 07 19:39:41.499466 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.499408    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee"} err="failed to get container status \"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee\": rpc error: code = NotFound desc = could not find container \"08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee\": container with ID starting with 08cb6a0e59aed7a1d06928d98fb963f03c93f81d4a230a128267f8069dcdcaee not found: ID does not exist"
Jul 07 19:39:41.512391 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.512368    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:39:41.516361 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:41.516342    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-6fe61d50-7966f9b4b-5nzpf"]
Jul 07 19:39:42.176589 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:39:42.176558    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dea0922-486e-40e0-b545-f3b8a599742a" path="/var/lib/kubelet/pods/6dea0922-486e-40e0-b545-f3b8a599742a/volumes"
Jul 07 19:41:39.672528 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.672498    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:41:39.672950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.672859    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea0922-486e-40e0-b545-f3b8a599742a" containerName="maas-api"
Jul 07 19:41:39.672950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.672873    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea0922-486e-40e0-b545-f3b8a599742a" containerName="maas-api"
Jul 07 19:41:39.672950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.672933    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dea0922-486e-40e0-b545-f3b8a599742a" containerName="maas-api"
Jul 07 19:41:39.675766 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.675750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.678627 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.678608    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-1aa2d9-serving-cert\""
Jul 07 19:41:39.678736 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.678611    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:41:39.708359 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.708336    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:41:39.838980 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.838950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.839156 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.838999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.839156 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.839024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnzc\" (UniqueName: \"kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.940378 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.940306    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.940378 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.940337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnzc\" (UniqueName: \"kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.940378 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.940374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.941001 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.940978    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.942805 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.942788    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.954747 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.954723    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnzc\" (UniqueName: \"kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc\") pod \"maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") " pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:39.985401 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:39.985380    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:40.122324 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:40.122303    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:41:40.124745 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:41:40.124722    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aea5527_dbc5_4ccd_b0a0_fa8b65c5fb9e.slice/crio-b4a5d751d01a043c7edd07bb2a4eed763093a88eb52026773211408ad0cf9338 WatchSource:0}: Error finding container b4a5d751d01a043c7edd07bb2a4eed763093a88eb52026773211408ad0cf9338: Status 404 returned error can't find the container with id b4a5d751d01a043c7edd07bb2a4eed763093a88eb52026773211408ad0cf9338
Jul 07 19:41:40.126553 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:40.126524    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:41:40.982439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:40.982360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" event={"ID":"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e","Type":"ContainerStarted","Data":"6bccee71aff155e36168fafe9f8ad79d4c6ab81598b085be42322c8d9583dfc3"}
Jul 07 19:41:40.982439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:40.982426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" event={"ID":"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e","Type":"ContainerStarted","Data":"b4a5d751d01a043c7edd07bb2a4eed763093a88eb52026773211408ad0cf9338"}
Jul 07 19:41:40.982826 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:40.982523    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:41.012163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:41.012119    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" podStartSLOduration=1.484521384 podStartE2EDuration="2.012081167s" totalImagesPullingTime="527.559783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:41:41.010608743 +0000 UTC m=+1945.419092299" watchObservedRunningTime="2026-07-07 19:41:41.012081167 +0000 UTC m=+1945.420564723"
Jul 07 19:41:46.992672 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:46.992643    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:41:47.835769 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.835732    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:41:47.839349 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.839327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:47.841951 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.841935    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-c47ca8-serving-cert\""
Jul 07 19:41:47.856456 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.856435    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:41:47.902074 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.902047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v487g\" (UniqueName: \"kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:47.902236 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.902118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:47.902236 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:47.902169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.003341 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.003313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v487g\" (UniqueName: \"kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.003741 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.003351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.003741 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.003376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.003741 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:41:48.003467    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-c47ca8-serving-cert: secret "maas-api-e2e-inf-b-c47ca8-serving-cert" not found
Jul 07 19:41:48.003741 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:41:48.003525    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls podName:b0d64d02-c95a-4454-85a7-e3900afb7d3a nodeName:}" failed. No retries permitted until 2026-07-07 19:41:48.503510063 +0000 UTC m=+1952.911993597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls") pod "maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" (UID: "b0d64d02-c95a-4454-85a7-e3900afb7d3a") : secret "maas-api-e2e-inf-b-c47ca8-serving-cert" not found
Jul 07 19:41:48.004201 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.004182    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.016568 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.016543    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v487g\" (UniqueName: \"kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.508181 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.508151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.510775 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.510752    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") pod \"maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") " pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.750245 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.750213    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:48.896613 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:48.896587    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:41:48.899178 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:41:48.899154    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d64d02_c95a_4454_85a7_e3900afb7d3a.slice/crio-59ac421a5a5f3d5e688fd16048cbf32c4b9c20f1268ef44df8221e95a175df68 WatchSource:0}: Error finding container 59ac421a5a5f3d5e688fd16048cbf32c4b9c20f1268ef44df8221e95a175df68: Status 404 returned error can't find the container with id 59ac421a5a5f3d5e688fd16048cbf32c4b9c20f1268ef44df8221e95a175df68
Jul 07 19:41:49.016928 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:49.016846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" event={"ID":"b0d64d02-c95a-4454-85a7-e3900afb7d3a","Type":"ContainerStarted","Data":"59ac421a5a5f3d5e688fd16048cbf32c4b9c20f1268ef44df8221e95a175df68"}
Jul 07 19:41:50.023839 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:50.023805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" event={"ID":"b0d64d02-c95a-4454-85a7-e3900afb7d3a","Type":"ContainerStarted","Data":"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"}
Jul 07 19:41:50.024266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:50.023921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:41:50.055209 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:50.055165    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" podStartSLOduration=2.751523703 podStartE2EDuration="3.055152393s" totalImagesPullingTime="303.62869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:41:50.055123038 +0000 UTC m=+1954.463606595" watchObservedRunningTime="2026-07-07 19:41:50.055152393 +0000 UTC m=+1954.463635947"
Jul 07 19:41:56.033407 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:41:56.033378    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:42:45.230589 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.230553    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:42:45.234355 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.234336    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.237447 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.237427    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-a48272-openshift-default-dockercfg-grncj\""
Jul 07 19:42:45.252123 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.252101    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:42:45.257713 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wlt5\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257823 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257812    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.257982 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.257967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.358852 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.358852 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wlt5\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.358964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359389 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359757 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359728    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359845 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359276    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359845 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359742    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.359950 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.359932    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.365944 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.360075    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.365944 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.362136    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.365944 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.362598    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.369709 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.369686    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wlt5\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.369812 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.369709    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token\") pod \"e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") " pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.544367 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.544340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:45.677014 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:45.676992    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:42:45.678764 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:42:45.678737    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9b32c2_13d6_4acd_8537_cfab101fbc19.slice/crio-1ad3ddbcbc447fc1c25ea61c295b4f3bb06c53f74909bcec14dd0d4b591a676b WatchSource:0}: Error finding container 1ad3ddbcbc447fc1c25ea61c295b4f3bb06c53f74909bcec14dd0d4b591a676b: Status 404 returned error can't find the container with id 1ad3ddbcbc447fc1c25ea61c295b4f3bb06c53f74909bcec14dd0d4b591a676b
Jul 07 19:42:46.251519 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:46.251492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerStarted","Data":"1ad3ddbcbc447fc1c25ea61c295b4f3bb06c53f74909bcec14dd0d4b591a676b"}
Jul 07 19:42:48.298318 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:48.298286    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:42:48.298550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:48.298355    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:42:48.298550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:48.298394    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:42:49.265500 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:49.265464    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerStarted","Data":"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"}
Jul 07 19:42:49.292799 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:49.292746    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podStartSLOduration=1.675996561 podStartE2EDuration="4.292729641s" totalImagesPullingTime="2.61673308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:42:49.292104602 +0000 UTC m=+2013.700588149" watchObservedRunningTime="2026-07-07 19:42:49.292729641 +0000 UTC m=+2013.701213197"
Jul 07 19:42:49.545388 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:49.545361    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:49.548987 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:49.548967    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:50.270130 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:50.270104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:50.271011 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:50.270994    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:42:51.277529 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.277500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:42:51.281042 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.281025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.283853 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.283830    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-reuse-a48272-serving-cert\""
Jul 07 19:42:51.292779 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.292756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:42:51.305021 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.304992    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.305172 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.305149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.305269 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.305255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkts\" (UniqueName: \"kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.406538 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.406503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.406705 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.406564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.406705 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.406611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkts\" (UniqueName: \"kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.406705 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:42:51.406663    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-reuse-a48272-serving-cert: secret "maas-api-e2e-reuse-a48272-serving-cert" not found
Jul 07 19:42:51.406881 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:42:51.406744    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls podName:261f775c-4218-43a0-9c32-f7f5c0a9c02f nodeName:}" failed. No retries permitted until 2026-07-07 19:42:51.90672199 +0000 UTC m=+2016.315205525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls") pod "maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" (UID: "261f775c-4218-43a0-9c32-f7f5c0a9c02f") : secret "maas-api-e2e-reuse-a48272-serving-cert" not found
Jul 07 19:42:51.407286 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.407266    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.418769 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.418748    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkts\" (UniqueName: \"kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.911487 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.911453    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:51.913911 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:51.913882    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") pod \"maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") " pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:52.191339 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:52.191258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:52.327954 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:52.327930    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:42:52.329965 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:42:52.329942    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261f775c_4218_43a0_9c32_f7f5c0a9c02f.slice/crio-b34a921c47413dbe0bc27e1859f7ed5d7343123c2cf8c02ea630cf72b92553ad WatchSource:0}: Error finding container b34a921c47413dbe0bc27e1859f7ed5d7343123c2cf8c02ea630cf72b92553ad: Status 404 returned error can't find the container with id b34a921c47413dbe0bc27e1859f7ed5d7343123c2cf8c02ea630cf72b92553ad
Jul 07 19:42:53.285291 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:53.285256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" event={"ID":"261f775c-4218-43a0-9c32-f7f5c0a9c02f","Type":"ContainerStarted","Data":"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"}
Jul 07 19:42:53.285472 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:53.285307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" event={"ID":"261f775c-4218-43a0-9c32-f7f5c0a9c02f","Type":"ContainerStarted","Data":"b34a921c47413dbe0bc27e1859f7ed5d7343123c2cf8c02ea630cf72b92553ad"}
Jul 07 19:42:53.285472 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:53.285362    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:42:53.313214 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:53.313173    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" podStartSLOduration=1.897808006 podStartE2EDuration="2.313158868s" totalImagesPullingTime="415.350862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:42:53.311909735 +0000 UTC m=+2017.720393293" watchObservedRunningTime="2026-07-07 19:42:53.313158868 +0000 UTC m=+2017.721642450"
Jul 07 19:42:59.294758 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:42:59.294727    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:43:14.375718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.375685    2570 generic.go:356] "Generic (PLEG): container finished" podID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerID="f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6" exitCode=0
Jul 07 19:43:14.376032 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.375760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerDied","Data":"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"}
Jul 07 19:43:14.376121 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.376108    2570 scope.go:117] "RemoveContainer" containerID="f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"
Jul 07 19:43:14.377965 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.377918    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:43:14.378053 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.378002    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:43:14.378053 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:14.378034    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:43:15.382597 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:15.382567    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerStarted","Data":"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"}
Jul 07 19:43:15.544502 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:15.544463    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:43:15.545771 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:15.545740    2570 patch_prober.go:28] interesting pod/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 19:43:15.545897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:15.545792    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 19:43:16.544669 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:16.544637    2570 patch_prober.go:28] interesting pod/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 19:43:16.545136 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:16.544684    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 19:43:17.545325 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:17.545291    2570 patch_prober.go:28] interesting pod/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 19:43:17.545687 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:17.545342    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 19:43:17.708447 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:17.707072    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:43:17.708447 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:17.707326    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" podUID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" containerName="maas-api" containerID="cri-o://7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade" gracePeriod=30
Jul 07 19:43:17.983014 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:17.982990    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:43:18.143232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.142280    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca\") pod \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") "
Jul 07 19:43:18.143232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.142362    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljkts\" (UniqueName: \"kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts\") pod \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") "
Jul 07 19:43:18.143232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.142457    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") pod \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\" (UID: \"261f775c-4218-43a0-9c32-f7f5c0a9c02f\") "
Jul 07 19:43:18.144916 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.144884    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "261f775c-4218-43a0-9c32-f7f5c0a9c02f" (UID: "261f775c-4218-43a0-9c32-f7f5c0a9c02f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:43:18.146017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.145984    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "261f775c-4218-43a0-9c32-f7f5c0a9c02f" (UID: "261f775c-4218-43a0-9c32-f7f5c0a9c02f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:43:18.147028 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.147002    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts" (OuterVolumeSpecName: "kube-api-access-ljkts") pod "261f775c-4218-43a0-9c32-f7f5c0a9c02f" (UID: "261f775c-4218-43a0-9c32-f7f5c0a9c02f"). InnerVolumeSpecName "kube-api-access-ljkts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:43:18.243903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.243872    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljkts\" (UniqueName: \"kubernetes.io/projected/261f775c-4218-43a0-9c32-f7f5c0a9c02f-kube-api-access-ljkts\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:43:18.243903 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.243902    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261f775c-4218-43a0-9c32-f7f5c0a9c02f-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:43:18.244122 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.243914    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261f775c-4218-43a0-9c32-f7f5c0a9c02f-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:43:18.395980 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.395897    2570 generic.go:356] "Generic (PLEG): container finished" podID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" containerID="7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade" exitCode=0
Jul 07 19:43:18.395980 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.395952    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"
Jul 07 19:43:18.396228 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.395982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" event={"ID":"261f775c-4218-43a0-9c32-f7f5c0a9c02f","Type":"ContainerDied","Data":"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"}
Jul 07 19:43:18.396228 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.396044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp" event={"ID":"261f775c-4218-43a0-9c32-f7f5c0a9c02f","Type":"ContainerDied","Data":"b34a921c47413dbe0bc27e1859f7ed5d7343123c2cf8c02ea630cf72b92553ad"}
Jul 07 19:43:18.396228 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.396074    2570 scope.go:117] "RemoveContainer" containerID="7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"
Jul 07 19:43:18.419170 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.419118    2570 scope.go:117] "RemoveContainer" containerID="7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"
Jul 07 19:43:18.419733 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:43:18.419705    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade\": container with ID starting with 7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade not found: ID does not exist" containerID="7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"
Jul 07 19:43:18.419902 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.419881    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade"} err="failed to get container status \"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade\": rpc error: code = NotFound desc = could not find container \"7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade\": container with ID starting with 7641f18e261bdec23ff8153f31a9a92f14455616c5d2526f90c765993fc40ade not found: ID does not exist"
Jul 07 19:43:18.430062 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.430020    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:43:18.433160 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.433138    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-reuse-a48272-7cf9cfcb9d-tgjnp"]
Jul 07 19:43:18.545116 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.545059    2570 patch_prober.go:28] interesting pod/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 19:43:18.545278 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:18.545144    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 19:43:19.548730 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:19.548702    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:43:19.549153 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:19.549069    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:43:19.549773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:19.549756    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:43:20.176606 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:43:20.176573    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" path="/var/lib/kubelet/pods/261f775c-4218-43a0-9c32-f7f5c0a9c02f/volumes"
Jul 07 19:44:07.113468 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:07.113397    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:44:07.113983 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:07.113625    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy" containerID="cri-o://5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac" gracePeriod=30
Jul 07 19:44:10.397069 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.397040    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:44:10.397467 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.397256    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" podUID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" containerName="maas-api" containerID="cri-o://6bccee71aff155e36168fafe9f8ad79d4c6ab81598b085be42322c8d9583dfc3" gracePeriod=30
Jul 07 19:44:10.620757 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.620728    2570 generic.go:356] "Generic (PLEG): container finished" podID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" containerID="6bccee71aff155e36168fafe9f8ad79d4c6ab81598b085be42322c8d9583dfc3" exitCode=0
Jul 07 19:44:10.620898 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.620771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" event={"ID":"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e","Type":"ContainerDied","Data":"6bccee71aff155e36168fafe9f8ad79d4c6ab81598b085be42322c8d9583dfc3"}
Jul 07 19:44:10.654229 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.654178    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:44:10.744785 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.744758    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca\") pod \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") "
Jul 07 19:44:10.744926 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.744816    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qnzc\" (UniqueName: \"kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc\") pod \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") "
Jul 07 19:44:10.744990 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.744927    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls\") pod \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\" (UID: \"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e\") "
Jul 07 19:44:10.745204 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.745182    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" (UID: "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:44:10.746931 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.746904    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc" (OuterVolumeSpecName: "kube-api-access-5qnzc") pod "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" (UID: "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e"). InnerVolumeSpecName "kube-api-access-5qnzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:44:10.747026 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.746944    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" (UID: "7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:44:10.845601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.845577    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:10.845601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.845599    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:10.845718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:10.845610    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qnzc\" (UniqueName: \"kubernetes.io/projected/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e-kube-api-access-5qnzc\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:11.626480 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:11.626449    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"
Jul 07 19:44:11.626862 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:11.626452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg" event={"ID":"7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e","Type":"ContainerDied","Data":"b4a5d751d01a043c7edd07bb2a4eed763093a88eb52026773211408ad0cf9338"}
Jul 07 19:44:11.626862 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:11.626563    2570 scope.go:117] "RemoveContainer" containerID="6bccee71aff155e36168fafe9f8ad79d4c6ab81598b085be42322c8d9583dfc3"
Jul 07 19:44:11.651812 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:11.651787    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:44:11.656720 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:11.656698    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1aa2d9-5f67f86ddc-r7vfg"]
Jul 07 19:44:12.175792 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.175766    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" path="/var/lib/kubelet/pods/7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e/volumes"
Jul 07 19:44:12.367710 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.367687    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:44:12.456180 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456121    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456180 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456158    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456182    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456237    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wlt5\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456259    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456302    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456329    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.456382 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456356    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo\") pod \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\" (UID: \"dd9b32c2-13d6-4acd-8537-cfab101fbc19\") "
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456418    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456584    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456626    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456663    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456670    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:44:12.457052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.456979    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:44:12.458571 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.458552    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5" (OuterVolumeSpecName: "kube-api-access-9wlt5") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "kube-api-access-9wlt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:44:12.458724 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.458702    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:44:12.458806 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.458759    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:44:12.458846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.458802    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd9b32c2-13d6-4acd-8537-cfab101fbc19" (UID: "dd9b32c2-13d6-4acd-8537-cfab101fbc19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:44:12.557694 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557668    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557694 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557690    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wlt5\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-kube-api-access-9wlt5\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557694 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557700    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557885 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557709    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557885 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557716    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557885 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557724    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557885 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557732    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.557885 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.557739    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9b32c2-13d6-4acd-8537-cfab101fbc19-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:12.632525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.632497    2570 generic.go:356] "Generic (PLEG): container finished" podID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerID="5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac" exitCode=0
Jul 07 19:44:12.632921 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.632546    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"
Jul 07 19:44:12.632921 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.632568    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerDied","Data":"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"}
Jul 07 19:44:12.632921 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.632620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf" event={"ID":"dd9b32c2-13d6-4acd-8537-cfab101fbc19","Type":"ContainerDied","Data":"1ad3ddbcbc447fc1c25ea61c295b4f3bb06c53f74909bcec14dd0d4b591a676b"}
Jul 07 19:44:12.632921 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.632649    2570 scope.go:117] "RemoveContainer" containerID="5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"
Jul 07 19:44:12.641645 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.641627    2570 scope.go:117] "RemoveContainer" containerID="f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"
Jul 07 19:44:12.649213 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.649196    2570 scope.go:117] "RemoveContainer" containerID="5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"
Jul 07 19:44:12.649444 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:44:12.649428    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac\": container with ID starting with 5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac not found: ID does not exist" containerID="5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"
Jul 07 19:44:12.649488 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.649449    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac"} err="failed to get container status \"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac\": rpc error: code = NotFound desc = could not find container \"5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac\": container with ID starting with 5505e2bf5a674b21d76b140fb00665a021d1b097f7e3e80ca5e1d287044ba3ac not found: ID does not exist"
Jul 07 19:44:12.649488 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.649465    2570 scope.go:117] "RemoveContainer" containerID="f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"
Jul 07 19:44:12.649654 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:44:12.649636    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6\": container with ID starting with f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6 not found: ID does not exist" containerID="f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"
Jul 07 19:44:12.649697 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.649661    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6"} err="failed to get container status \"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6\": rpc error: code = NotFound desc = could not find container \"f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6\": container with ID starting with f36d777588b90103f2481969d799a947d800032cf6c51af2f116c9ecd47134e6 not found: ID does not exist"
Jul 07 19:44:12.659266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.659247    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:44:12.665358 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:12.665339    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-a48272-openshift-default-b59cb64cf-ggvbf"]
Jul 07 19:44:14.177592 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:14.177557    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" path="/var/lib/kubelet/pods/dd9b32c2-13d6-4acd-8537-cfab101fbc19/volumes"
Jul 07 19:44:16.141490 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:16.141460    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:44:16.144545 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:16.144524    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:44:16.148678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:16.148658    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:44:16.151514 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:16.151494    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:44:53.952892 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:53.952862    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:44:53.953439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:53.953109    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" podUID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" containerName="maas-api" containerID="cri-o://c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092" gracePeriod=30
Jul 07 19:44:54.191324 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.191299    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:44:54.275788 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.275721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") pod \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") "
Jul 07 19:44:54.275788 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.275777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v487g\" (UniqueName: \"kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g\") pod \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") "
Jul 07 19:44:54.275985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.275833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca\") pod \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\" (UID: \"b0d64d02-c95a-4454-85a7-e3900afb7d3a\") "
Jul 07 19:44:54.276455 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.276314    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0d64d02-c95a-4454-85a7-e3900afb7d3a" (UID: "b0d64d02-c95a-4454-85a7-e3900afb7d3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:44:54.278409 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.278384    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0d64d02-c95a-4454-85a7-e3900afb7d3a" (UID: "b0d64d02-c95a-4454-85a7-e3900afb7d3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:44:54.278409 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.278395    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g" (OuterVolumeSpecName: "kube-api-access-v487g") pod "b0d64d02-c95a-4454-85a7-e3900afb7d3a" (UID: "b0d64d02-c95a-4454-85a7-e3900afb7d3a"). InnerVolumeSpecName "kube-api-access-v487g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:44:54.376897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.376867    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v487g\" (UniqueName: \"kubernetes.io/projected/b0d64d02-c95a-4454-85a7-e3900afb7d3a-kube-api-access-v487g\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:54.376897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.376893    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d64d02-c95a-4454-85a7-e3900afb7d3a-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:54.377022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.376906    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0d64d02-c95a-4454-85a7-e3900afb7d3a-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:44:54.817517 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.817484    2570 generic.go:356] "Generic (PLEG): container finished" podID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" containerID="c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092" exitCode=0
Jul 07 19:44:54.817681 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.817536    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"
Jul 07 19:44:54.817681 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.817543    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" event={"ID":"b0d64d02-c95a-4454-85a7-e3900afb7d3a","Type":"ContainerDied","Data":"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"}
Jul 07 19:44:54.817681 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.817594    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv" event={"ID":"b0d64d02-c95a-4454-85a7-e3900afb7d3a","Type":"ContainerDied","Data":"59ac421a5a5f3d5e688fd16048cbf32c4b9c20f1268ef44df8221e95a175df68"}
Jul 07 19:44:54.817681 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.817624    2570 scope.go:117] "RemoveContainer" containerID="c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"
Jul 07 19:44:54.826283 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.826266    2570 scope.go:117] "RemoveContainer" containerID="c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"
Jul 07 19:44:54.826549 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:44:54.826527    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092\": container with ID starting with c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092 not found: ID does not exist" containerID="c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"
Jul 07 19:44:54.826644 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.826560    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092"} err="failed to get container status \"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092\": rpc error: code = NotFound desc = could not find container \"c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092\": container with ID starting with c948979045d4cf19944abdd84ad45b37316fd990c5b1671a0cc92d0f3196a092 not found: ID does not exist"
Jul 07 19:44:54.840383 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.840363    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:44:54.844817 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:54.844799    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c47ca8-55fcdb87fb-bglbv"]
Jul 07 19:44:56.176445 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:44:56.176416    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" path="/var/lib/kubelet/pods/b0d64d02-c95a-4454-85a7-e3900afb7d3a/volumes"
Jul 07 19:45:00.143551 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143516    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724225-5bvpc"]
Jul 07 19:45:00.143985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143940    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" containerName="maas-api"
Jul 07 19:45:00.143985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143957    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" containerName="maas-api"
Jul 07 19:45:00.143985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143969    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.143985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143976    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.143985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143987    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.143995    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144013    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144021    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144035    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144043    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144172    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d64d02-c95a-4454-85a7-e3900afb7d3a" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144187    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aea5527-dbc5-4ccd-b0a0-fa8b65c5fb9e" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144196    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="261f775c-4218-43a0-9c32-f7f5c0a9c02f" containerName="maas-api"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144203    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.144327 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.144214    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd9b32c2-13d6-4acd-8537-cfab101fbc19" containerName="istio-proxy"
Jul 07 19:45:00.148603 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.148584    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:00.151831 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.151811    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:45:00.160928 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.160907    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724225-5bvpc"]
Jul 07 19:45:00.221385 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.221354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qcpz\" (UniqueName: \"kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz\") pod \"maas-api-key-cleanup-29724225-5bvpc\" (UID: \"176814b3-eb9b-4dea-a67f-598706d36e6e\") " pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:00.321947 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.321913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qcpz\" (UniqueName: \"kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz\") pod \"maas-api-key-cleanup-29724225-5bvpc\" (UID: \"176814b3-eb9b-4dea-a67f-598706d36e6e\") " pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:00.331388 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.331363    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qcpz\" (UniqueName: \"kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz\") pod \"maas-api-key-cleanup-29724225-5bvpc\" (UID: \"176814b3-eb9b-4dea-a67f-598706d36e6e\") " pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:00.457782 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.457705    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:00.589802 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.589782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724225-5bvpc"]
Jul 07 19:45:00.591614 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:00.591587    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176814b3_eb9b_4dea_a67f_598706d36e6e.slice/crio-f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69 WatchSource:0}: Error finding container f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69: Status 404 returned error can't find the container with id f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69
Jul 07 19:45:00.845063 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:00.845035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc" event={"ID":"176814b3-eb9b-4dea-a67f-598706d36e6e","Type":"ContainerStarted","Data":"f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69"}
Jul 07 19:45:01.268439 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.268371    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:01.272557 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.272538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.275664 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.275644    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-129454-openshift-default-dockercfg-lv6r5\""
Jul 07 19:45:01.284723 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.284700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:01.331141 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331266 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331455 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331455 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.331455 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.331395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49jst\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.431943 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.431910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.431950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.431976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432145 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432134    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432457 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432159    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432457 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49jst\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432457 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432393    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432457 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432426    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432627 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432526    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432627 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432592    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.432984 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.432959    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.434591 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.434571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.434702 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.434686    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.448827 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.448801    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.448912 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.448841    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49jst\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst\") pod \"e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") " pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.582589 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.582566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:01.737100 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.737058    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:01.739294 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:01.739266    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9a9cc9_a85c_450f_b1c2_3de17f07b643.slice/crio-a0ced25ef27c0480cfd31105b7298904b451a546c468bc70f79428de2490c03d WatchSource:0}: Error finding container a0ced25ef27c0480cfd31105b7298904b451a546c468bc70f79428de2490c03d: Status 404 returned error can't find the container with id a0ced25ef27c0480cfd31105b7298904b451a546c468bc70f79428de2490c03d
Jul 07 19:45:01.743579 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.743212    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:01.743579 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.743302    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:01.743579 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.743339    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:01.853930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.853846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerStarted","Data":"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"}
Jul 07 19:45:01.854067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.853955    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerStarted","Data":"a0ced25ef27c0480cfd31105b7298904b451a546c468bc70f79428de2490c03d"}
Jul 07 19:45:01.880553 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:01.880494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podStartSLOduration=0.880472903 podStartE2EDuration="880.472903ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:01.877393858 +0000 UTC m=+2146.285877415" watchObservedRunningTime="2026-07-07 19:45:01.880472903 +0000 UTC m=+2146.288956460"
Jul 07 19:45:02.583007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:02.582972    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:02.588353 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:02.588330    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:02.859717 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:02.859646    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:02.860902 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:02.860881    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:03.865667 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.865628    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc" event={"ID":"176814b3-eb9b-4dea-a67f-598706d36e6e","Type":"ContainerStarted","Data":"feab69495c9df8a7efc94be39bee14c3a91fad8145a1d91a76db1bc258e0f03c"}
Jul 07 19:45:03.887132 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.887056    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc" podStartSLOduration=1.508808961 podStartE2EDuration="3.887035553s" totalImagesPullingTime="2.378226592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:03.884911849 +0000 UTC m=+2148.293395408" watchObservedRunningTime="2026-07-07 19:45:03.887035553 +0000 UTC m=+2148.295519109"
Jul 07 19:45:03.896722 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.896692    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:03.900165 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.900149    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:03.903129 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.903109    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-129454-serving-cert\""
Jul 07 19:45:03.910692 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.910648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:03.956459 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.956428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:03.956617 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.956588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685cf\" (UniqueName: \"kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:03.956694 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:03.956682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.057268 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.057238    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685cf\" (UniqueName: \"kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.057401 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.057291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.057401 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.057359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.057503 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:04.057470    2570 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-129454-serving-cert: secret "maas-api-e2e-api-a-129454-serving-cert" not found
Jul 07 19:45:04.057574 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:04.057561    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls podName:2eb4336b-3355-4c33-9f07-9ab38dc27607 nodeName:}" failed. No retries permitted until 2026-07-07 19:45:04.557538849 +0000 UTC m=+2148.966022399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls") pod "maas-api-e2e-api-a-129454-974d9ddf9-nptz7" (UID: "2eb4336b-3355-4c33-9f07-9ab38dc27607") : secret "maas-api-e2e-api-a-129454-serving-cert" not found
Jul 07 19:45:04.057944 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.057926    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.071195 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.071175    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-685cf\" (UniqueName: \"kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.562010 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.561977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.564787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.564747    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") pod \"maas-api-e2e-api-a-129454-974d9ddf9-nptz7\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") " pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.811366 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.811332    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:04.873654 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.873578    2570 generic.go:356] "Generic (PLEG): container finished" podID="176814b3-eb9b-4dea-a67f-598706d36e6e" containerID="feab69495c9df8a7efc94be39bee14c3a91fad8145a1d91a76db1bc258e0f03c" exitCode=0
Jul 07 19:45:04.874061 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.873766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc" event={"ID":"176814b3-eb9b-4dea-a67f-598706d36e6e","Type":"ContainerDied","Data":"feab69495c9df8a7efc94be39bee14c3a91fad8145a1d91a76db1bc258e0f03c"}
Jul 07 19:45:04.949524 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:04.949508    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:04.951540 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:04.951512    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb4336b_3355_4c33_9f07_9ab38dc27607.slice/crio-affdaba033fc50a709a5d9f9b3228ef2b8058fdae715802045e3ff81a2131c6a WatchSource:0}: Error finding container affdaba033fc50a709a5d9f9b3228ef2b8058fdae715802045e3ff81a2131c6a: Status 404 returned error can't find the container with id affdaba033fc50a709a5d9f9b3228ef2b8058fdae715802045e3ff81a2131c6a
Jul 07 19:45:05.880416 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:05.880379    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" event={"ID":"2eb4336b-3355-4c33-9f07-9ab38dc27607","Type":"ContainerStarted","Data":"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"}
Jul 07 19:45:05.880852 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:05.880430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" event={"ID":"2eb4336b-3355-4c33-9f07-9ab38dc27607","Type":"ContainerStarted","Data":"affdaba033fc50a709a5d9f9b3228ef2b8058fdae715802045e3ff81a2131c6a"}
Jul 07 19:45:05.905735 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:05.905675    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" podStartSLOduration=2.433783371 podStartE2EDuration="2.905652573s" totalImagesPullingTime="471.869202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:05.904296323 +0000 UTC m=+2150.312779882" watchObservedRunningTime="2026-07-07 19:45:05.905652573 +0000 UTC m=+2150.314136130"
Jul 07 19:45:06.011132 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.011058    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:06.076970 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.076940    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qcpz\" (UniqueName: \"kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz\") pod \"176814b3-eb9b-4dea-a67f-598706d36e6e\" (UID: \"176814b3-eb9b-4dea-a67f-598706d36e6e\") "
Jul 07 19:45:06.079027 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.079000    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz" (OuterVolumeSpecName: "kube-api-access-7qcpz") pod "176814b3-eb9b-4dea-a67f-598706d36e6e" (UID: "176814b3-eb9b-4dea-a67f-598706d36e6e"). InnerVolumeSpecName "kube-api-access-7qcpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:06.177808 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.177751    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qcpz\" (UniqueName: \"kubernetes.io/projected/176814b3-eb9b-4dea-a67f-598706d36e6e-kube-api-access-7qcpz\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:06.885481 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.885450    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc"
Jul 07 19:45:06.885915 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.885482    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724225-5bvpc" event={"ID":"176814b3-eb9b-4dea-a67f-598706d36e6e","Type":"ContainerDied","Data":"f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69"}
Jul 07 19:45:06.885915 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.885559    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f344e519630a45e16105aec85b0136a5a3a29d93cebb8759639bbb140cc5dc69"
Jul 07 19:45:06.885915 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:06.885775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:09.053647 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.053621    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:09.053986 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.053926    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176814b3-eb9b-4dea-a67f-598706d36e6e" containerName="cleanup"
Jul 07 19:45:09.053986 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.053936    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="176814b3-eb9b-4dea-a67f-598706d36e6e" containerName="cleanup"
Jul 07 19:45:09.054050 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.053989    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="176814b3-eb9b-4dea-a67f-598706d36e6e" containerName="cleanup"
Jul 07 19:45:09.056846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.056830    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.059548 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.059526    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b4b8d7-openshift-default-dockercfg-7skwb\""
Jul 07 19:45:09.070128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.070080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:09.097803 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pbqg\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.097892 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.097892 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097876    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.097988 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.097988 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.097988 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.097982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.098174 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.098009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.098174 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.098027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.098174 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.098065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198719 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pbqg\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198827    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.198871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.198957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199309 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.199176    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199309 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.199230    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199410 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.199373    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199464 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.199429    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.199749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.199730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.201275 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.201252    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.201393 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.201359    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.209347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.209317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.209456 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.209418    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pbqg\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg\") pod \"e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") " pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.366644 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.366569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:09.505923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.505897    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:09.507109 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:09.507072    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627d030c_2f65_4cc8_b0f6_0fb95fc66670.slice/crio-31650c2013c0175665eb833edfab46ee09a70b1f1507692e24828fe34ea2f0d1 WatchSource:0}: Error finding container 31650c2013c0175665eb833edfab46ee09a70b1f1507692e24828fe34ea2f0d1: Status 404 returned error can't find the container with id 31650c2013c0175665eb833edfab46ee09a70b1f1507692e24828fe34ea2f0d1
Jul 07 19:45:09.509072 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.509041    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:09.509177 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.509122    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:09.509177 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.509153    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:09.900034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.900002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerStarted","Data":"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"}
Jul 07 19:45:09.900245 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.900056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerStarted","Data":"31650c2013c0175665eb833edfab46ee09a70b1f1507692e24828fe34ea2f0d1"}
Jul 07 19:45:09.927754 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:09.927711    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podStartSLOduration=0.927696478 podStartE2EDuration="927.696478ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:09.925409162 +0000 UTC m=+2154.333892719" watchObservedRunningTime="2026-07-07 19:45:09.927696478 +0000 UTC m=+2154.336180034"
Jul 07 19:45:10.367046 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:10.367006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:10.372140 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:10.372116    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:10.907887 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:10.907854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:10.915960 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:10.915922    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:12.896411 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:12.896383    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:17.861662 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.861628    2570 patch_prober.go:28] interesting pod/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 19:45:17.862055 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.861706    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 19:45:17.948098 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.948063    2570 generic.go:356] "Generic (PLEG): container finished" podID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerID="a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf" exitCode=0
Jul 07 19:45:17.948242 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.948140    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerDied","Data":"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"}
Jul 07 19:45:17.948473 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.948461    2570 scope.go:117] "RemoveContainer" containerID="a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"
Jul 07 19:45:17.949441 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.949415    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:17.949529 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.949479    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:17.949569 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:17.949527    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:18.954773 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:18.954735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerStarted","Data":"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"}
Jul 07 19:45:19.583602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:19.583566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:19.583831 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:19.583804    2570 patch_prober.go:28] interesting pod/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 19:45:19.583898 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:19.583874    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 19:45:20.583177 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:20.583146    2570 patch_prober.go:28] interesting pod/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 19:45:20.583541 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:20.583201    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 19:45:21.583146 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:21.583111    2570 patch_prober.go:28] interesting pod/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 19:45:21.583319 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:21.583167    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 19:45:22.583693 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:22.583650    2570 patch_prober.go:28] interesting pod/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 19:45:22.584069 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:22.583706    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 19:45:23.586383 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:23.586349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:23.586812 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:23.586626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:23.587276 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:23.587258    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:25.243162 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.242424    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:25.244346 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.243881    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" podUID="2eb4336b-3355-4c33-9f07-9ab38dc27607" containerName="maas-api" containerID="cri-o://fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c" gracePeriod=30
Jul 07 19:45:25.496990 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.496928    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:25.657233 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.657201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca\") pod \"2eb4336b-3355-4c33-9f07-9ab38dc27607\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") "
Jul 07 19:45:25.657416 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.657281    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") pod \"2eb4336b-3355-4c33-9f07-9ab38dc27607\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") "
Jul 07 19:45:25.657416 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.657317    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-685cf\" (UniqueName: \"kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf\") pod \"2eb4336b-3355-4c33-9f07-9ab38dc27607\" (UID: \"2eb4336b-3355-4c33-9f07-9ab38dc27607\") "
Jul 07 19:45:25.657624 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.657600    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2eb4336b-3355-4c33-9f07-9ab38dc27607" (UID: "2eb4336b-3355-4c33-9f07-9ab38dc27607"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:45:25.659453 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.659424    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2eb4336b-3355-4c33-9f07-9ab38dc27607" (UID: "2eb4336b-3355-4c33-9f07-9ab38dc27607"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:45:25.659545 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.659504    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf" (OuterVolumeSpecName: "kube-api-access-685cf") pod "2eb4336b-3355-4c33-9f07-9ab38dc27607" (UID: "2eb4336b-3355-4c33-9f07-9ab38dc27607"). InnerVolumeSpecName "kube-api-access-685cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:25.757955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.757891    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb4336b-3355-4c33-9f07-9ab38dc27607-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:25.757955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.757916    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2eb4336b-3355-4c33-9f07-9ab38dc27607-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:25.757955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.757925    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-685cf\" (UniqueName: \"kubernetes.io/projected/2eb4336b-3355-4c33-9f07-9ab38dc27607-kube-api-access-685cf\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:25.987617 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.987582    2570 generic.go:356] "Generic (PLEG): container finished" podID="2eb4336b-3355-4c33-9f07-9ab38dc27607" containerID="fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c" exitCode=0
Jul 07 19:45:25.987749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.987621    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"
Jul 07 19:45:25.987749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.987642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" event={"ID":"2eb4336b-3355-4c33-9f07-9ab38dc27607","Type":"ContainerDied","Data":"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"}
Jul 07 19:45:25.987749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.987696    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7" event={"ID":"2eb4336b-3355-4c33-9f07-9ab38dc27607","Type":"ContainerDied","Data":"affdaba033fc50a709a5d9f9b3228ef2b8058fdae715802045e3ff81a2131c6a"}
Jul 07 19:45:25.987749 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.987726    2570 scope.go:117] "RemoveContainer" containerID="fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"
Jul 07 19:45:25.996573 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.996555    2570 scope.go:117] "RemoveContainer" containerID="fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"
Jul 07 19:45:25.996810 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:25.996792    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c\": container with ID starting with fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c not found: ID does not exist" containerID="fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"
Jul 07 19:45:25.996871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:25.996816    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c"} err="failed to get container status \"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c\": rpc error: code = NotFound desc = could not find container \"fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c\": container with ID starting with fb9be788e33af10029abd098756a90b447f7770716068038d62d71e14f9c8b2c not found: ID does not exist"
Jul 07 19:45:26.010871 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.010813    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:26.015798 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.015778    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-129454-974d9ddf9-nptz7"]
Jul 07 19:45:26.176602 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.176576    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb4336b-3355-4c33-9f07-9ab38dc27607" path="/var/lib/kubelet/pods/2eb4336b-3355-4c33-9f07-9ab38dc27607/volumes"
Jul 07 19:45:26.915408 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.914970    2570 patch_prober.go:28] interesting pod/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:45:26.915408 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.915066    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:45:26.993550 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.993518    2570 generic.go:356] "Generic (PLEG): container finished" podID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerID="d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91" exitCode=0
Jul 07 19:45:26.993656 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.993590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerDied","Data":"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"}
Jul 07 19:45:26.994034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.994012    2570 scope.go:117] "RemoveContainer" containerID="d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"
Jul 07 19:45:26.995052 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.995025    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:26.995168 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.995108    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:26.995168 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:26.995142    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:28.001840 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:28.001799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerStarted","Data":"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"}
Jul 07 19:45:28.367663 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:28.367623    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:28.367939 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:28.367916    2570 patch_prober.go:28] interesting pod/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 19:45:28.368022 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:28.367970    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 19:45:29.367900 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:29.367867    2570 patch_prober.go:28] interesting pod/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 19:45:29.368290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:29.367917    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 19:45:30.367714 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:30.367679    2570 patch_prober.go:28] interesting pod/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 19:45:30.367887 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:30.367729    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 19:45:31.367430 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:31.367394    2570 patch_prober.go:28] interesting pod/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 19:45:31.367789 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:31.367454    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 19:45:31.768691 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:31.768618    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:31.768858 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:31.768836    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy" containerID="cri-o://33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87" gracePeriod=30
Jul 07 19:45:32.370397 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:32.370360    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:32.370759 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:32.370610    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:32.371394 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:32.371378    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:37.017862 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.017838    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:37.047934 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.047902    2570 generic.go:356] "Generic (PLEG): container finished" podID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerID="33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87" exitCode=0
Jul 07 19:45:37.048062 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.047966    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"
Jul 07 19:45:37.048062 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.048002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerDied","Data":"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"}
Jul 07 19:45:37.048168 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.048116    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr" event={"ID":"ce9a9cc9-a85c-450f-b1c2-3de17f07b643","Type":"ContainerDied","Data":"a0ced25ef27c0480cfd31105b7298904b451a546c468bc70f79428de2490c03d"}
Jul 07 19:45:37.048168 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.048152    2570 scope.go:117] "RemoveContainer" containerID="33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"
Jul 07 19:45:37.053613 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053591    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053631    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053691    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053738 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053804    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49jst\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053834    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053859    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.053897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053882    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs\") pod \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\" (UID: \"ce9a9cc9-a85c-450f-b1c2-3de17f07b643\") "
Jul 07 19:45:37.054166 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.053996    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:37.054166 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.054106    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:45:37.054919 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.054223    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:37.055105 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.054369    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:37.055232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.055146    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:37.055232 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.054204    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.056428 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.056394    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:37.056577 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.056551    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:45:37.056663 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.056609    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:37.056784 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.056767    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst" (OuterVolumeSpecName: "kube-api-access-49jst") pod "ce9a9cc9-a85c-450f-b1c2-3de17f07b643" (UID: "ce9a9cc9-a85c-450f-b1c2-3de17f07b643"). InnerVolumeSpecName "kube-api-access-49jst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:37.058332 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.058316    2570 scope.go:117] "RemoveContainer" containerID="a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"
Jul 07 19:45:37.072622 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.072602    2570 scope.go:117] "RemoveContainer" containerID="33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"
Jul 07 19:45:37.072906 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:37.072888    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87\": container with ID starting with 33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87 not found: ID does not exist" containerID="33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"
Jul 07 19:45:37.072972 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.072915    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87"} err="failed to get container status \"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87\": rpc error: code = NotFound desc = could not find container \"33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87\": container with ID starting with 33dc0dd9c1696d90dd10ccaf98e9bd1cd66ba1f83875dff3e6be7793dbc88b87 not found: ID does not exist"
Jul 07 19:45:37.072972 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.072934    2570 scope.go:117] "RemoveContainer" containerID="a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"
Jul 07 19:45:37.073231 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:37.073204    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf\": container with ID starting with a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf not found: ID does not exist" containerID="a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"
Jul 07 19:45:37.073277 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.073242    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf"} err="failed to get container status \"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf\": rpc error: code = NotFound desc = could not find container \"a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf\": container with ID starting with a612d1d6b4f14b7605863fa94c641b7824282cf99c558cc97bab7f69d002ceaf not found: ID does not exist"
Jul 07 19:45:37.155789 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155765    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155789 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155786    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155795    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155802    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155810    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49jst\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-kube-api-access-49jst\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155819    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155827    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.155922 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.155834    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9a9cc9-a85c-450f-b1c2-3de17f07b643-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:37.372368 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.372341    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:37.377358 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:37.377339    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-129454-openshift-default-6f9b66cc69-w2cqr"]
Jul 07 19:45:38.176265 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:38.176232    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" path="/var/lib/kubelet/pods/ce9a9cc9-a85c-450f-b1c2-3de17f07b643/volumes"
Jul 07 19:45:39.540013 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:39.539985    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:39.540452 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:39.540235    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy" containerID="cri-o://31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96" gracePeriod=30
Jul 07 19:45:40.401955 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.401926    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:45:40.402302 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402289    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:40.402356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402304    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:40.402356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402314    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:40.402356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402319    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:40.402356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402325    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb4336b-3355-4c33-9f07-9ab38dc27607" containerName="maas-api"
Jul 07 19:45:40.402356 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402331    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb4336b-3355-4c33-9f07-9ab38dc27607" containerName="maas-api"
Jul 07 19:45:40.402508 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402391    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:40.402508 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.402398    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb4336b-3355-4c33-9f07-9ab38dc27607" containerName="maas-api"
Jul 07 19:45:40.405367 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.405351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.408041 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.408022    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-78237e-openshift-default-dockercfg-lw8x5\""
Jul 07 19:45:40.417985 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.417962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:45:40.480513 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480569    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480615    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsh9m\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480671 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480729    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480791    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.480930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.480847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581414 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsh9m\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581846 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581999 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.581999 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.581982    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582132 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582132 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582233 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582233 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582513 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582487    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582631 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582513    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582631 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.582631 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.582621    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.583726 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.583691    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.584199 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.584181    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.592702 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.592677    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.592842 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.592820    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsh9m\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m\") pod \"e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") " pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.715598 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.715516    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:40.850888 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.850862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:45:40.853368 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:40.853346    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e742a1_cbe8_4b61_b319_c31f8404376a.slice/crio-36a194e552b484990b6143ac11441f37e76d004e40c09d0cde70fea189afd587 WatchSource:0}: Error finding container 36a194e552b484990b6143ac11441f37e76d004e40c09d0cde70fea189afd587: Status 404 returned error can't find the container with id 36a194e552b484990b6143ac11441f37e76d004e40c09d0cde70fea189afd587
Jul 07 19:45:40.855386 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.855352    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:40.855475 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.855420    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:40.855514 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:40.855474    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:41.068905 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:41.068877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerStarted","Data":"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"}
Jul 07 19:45:41.069163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:41.068926    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerStarted","Data":"36a194e552b484990b6143ac11441f37e76d004e40c09d0cde70fea189afd587"}
Jul 07 19:45:41.095285 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:41.095232    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podStartSLOduration=1.095211863 podStartE2EDuration="1.095211863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:41.094296067 +0000 UTC m=+2185.502779625" watchObservedRunningTime="2026-07-07 19:45:41.095211863 +0000 UTC m=+2185.503695420"
Jul 07 19:45:41.716702 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:41.716667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:41.721311 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:41.721285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:42.073648 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:42.073614    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:42.074577 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:42.074561    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:44.793190 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.793168    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:44.920034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.919968    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920001    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920034 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920024    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920059    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920119    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920140    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920308 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920225    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pbqg\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg\") pod \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\" (UID: \"627d030c-2f65-4cc8-b0f6-0fb95fc66670\") "
Jul 07 19:45:44.920595 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920423    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:44.920595 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920439    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:44.920595 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920481    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:45:44.920741 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.920617    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:44.921124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.921104    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data" (OuterVolumeSpecName: "istio-data") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:44.922376 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.922344    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token" (OuterVolumeSpecName: "istio-token") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:44.922472 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.922417    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg" (OuterVolumeSpecName: "kube-api-access-4pbqg") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "kube-api-access-4pbqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:45:44.922779 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.922751    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:45:44.922779 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:44.922752    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "627d030c-2f65-4cc8-b0f6-0fb95fc66670" (UID: "627d030c-2f65-4cc8-b0f6-0fb95fc66670"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:45:45.021569 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021540    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021569 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021565    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pbqg\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-kube-api-access-4pbqg\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021569 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021574    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021582    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021590    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021599    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/627d030c-2f65-4cc8-b0f6-0fb95fc66670-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021606    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021614    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.021751 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.021621    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/627d030c-2f65-4cc8-b0f6-0fb95fc66670-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:45:45.089222 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.089190    2570 generic.go:356] "Generic (PLEG): container finished" podID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerID="31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96" exitCode=0
Jul 07 19:45:45.089333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.089244    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"
Jul 07 19:45:45.089333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.089277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerDied","Data":"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"}
Jul 07 19:45:45.089333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.089328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8" event={"ID":"627d030c-2f65-4cc8-b0f6-0fb95fc66670","Type":"ContainerDied","Data":"31650c2013c0175665eb833edfab46ee09a70b1f1507692e24828fe34ea2f0d1"}
Jul 07 19:45:45.089427 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.089351    2570 scope.go:117] "RemoveContainer" containerID="31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"
Jul 07 19:45:45.098306 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.098290    2570 scope.go:117] "RemoveContainer" containerID="d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"
Jul 07 19:45:45.105991 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.105970    2570 scope.go:117] "RemoveContainer" containerID="31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"
Jul 07 19:45:45.106270 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:45.106252    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96\": container with ID starting with 31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96 not found: ID does not exist" containerID="31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"
Jul 07 19:45:45.106333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.106279    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96"} err="failed to get container status \"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96\": rpc error: code = NotFound desc = could not find container \"31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96\": container with ID starting with 31e2284703331f9d617eeb60be88036c12261608c9fe68ead530dac17e1ebc96 not found: ID does not exist"
Jul 07 19:45:45.106333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.106296    2570 scope.go:117] "RemoveContainer" containerID="d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"
Jul 07 19:45:45.106538 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:45:45.106519    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91\": container with ID starting with d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91 not found: ID does not exist" containerID="d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"
Jul 07 19:45:45.106586 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.106547    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91"} err="failed to get container status \"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91\": rpc error: code = NotFound desc = could not find container \"d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91\": container with ID starting with d0f02c213e0f79886add5d1fe84dd9746280f6415168f3930d99fab0b0ea3a91 not found: ID does not exist"
Jul 07 19:45:45.126834 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.126814    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:45.128213 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:45.128197    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b4b8d7-openshift-default-54f7b57f9f-kkxf8"]
Jul 07 19:45:46.176049 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:46.176017    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" path="/var/lib/kubelet/pods/627d030c-2f65-4cc8-b0f6-0fb95fc66670/volumes"
Jul 07 19:45:48.122291 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122259    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:45:48.122642 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122627    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:48.122693 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122643    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:48.122723 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122705    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:48.122723 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122712    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:48.122723 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.122719    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9a9cc9-a85c-450f-b1c2-3de17f07b643" containerName="istio-proxy"
Jul 07 19:45:48.125647 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.125629    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.128336 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.128314    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-0a6be4-openshift-default-dockercfg-8zk9x\""
Jul 07 19:45:48.146556 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.146533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:45:48.243995 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.243964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244164    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqkvc\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244351 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244351 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.244351 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.244255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.344831 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344797    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.344831 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344862    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.344978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345033 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345029    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqkvc\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345402 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345242    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345402 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345333    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345404    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345507 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345428    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.345641 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.345622    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.347330 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.347306    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.347673 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.347655    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.355423 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.355398    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.355554 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.355522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqkvc\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc\") pod \"e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") " pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.435801 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.435734    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:48.571290 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.571236    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:45:48.572639 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:48.572605    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724bae04_89cd_456f_b8d5_1b5231fca61f.slice/crio-9038c5a050ddc1f450388656bbe8acb4f81475a53d3736707fc712740cafaa94 WatchSource:0}: Error finding container 9038c5a050ddc1f450388656bbe8acb4f81475a53d3736707fc712740cafaa94: Status 404 returned error can't find the container with id 9038c5a050ddc1f450388656bbe8acb4f81475a53d3736707fc712740cafaa94
Jul 07 19:45:48.574990 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.574955    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:48.575076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.575027    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:48.575076 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:48.575057    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:49.111715 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:49.111668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerStarted","Data":"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"}
Jul 07 19:45:49.111911 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:49.111743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerStarted","Data":"9038c5a050ddc1f450388656bbe8acb4f81475a53d3736707fc712740cafaa94"}
Jul 07 19:45:49.139795 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:49.139735    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podStartSLOduration=1.139716727 podStartE2EDuration="1.139716727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:49.137977055 +0000 UTC m=+2193.546460802" watchObservedRunningTime="2026-07-07 19:45:49.139716727 +0000 UTC m=+2193.548200283"
Jul 07 19:45:49.436551 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:49.436461    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:49.441392 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:49.441368    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:50.119383 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:50.119224    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:50.121915 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:50.121712    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:45:51.284456 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.284420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:45:51.284930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.284910    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:51.284978 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.284935    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="627d030c-2f65-4cc8-b0f6-0fb95fc66670" containerName="istio-proxy"
Jul 07 19:45:51.287378 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.287356    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.290395 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.290370    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-0a6be4-serving-cert\""
Jul 07 19:45:51.290519 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.290418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8pz6d\""
Jul 07 19:45:51.308112 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.300936    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:45:51.371079 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.371045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.371079 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.371078    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.371329 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.371157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdr8z\" (UniqueName: \"kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.471655 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.471628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.471655 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.471657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.471888 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.471685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdr8z\" (UniqueName: \"kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.472409 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.472387    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.474164 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.474139    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.483701 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.483678    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdr8z\" (UniqueName: \"kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z\") pod \"maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") " pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.597897 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.597871    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:51.777387 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:51.777308    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:45:51.779367 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:45:51.779341    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff3bb6a_a094_4f96_a44c_40b45d6e0f47.slice/crio-c5ef30075b927939fc77043cf0ec7557ae54d0df5aab7cb99c062b80e08fb5fd WatchSource:0}: Error finding container c5ef30075b927939fc77043cf0ec7557ae54d0df5aab7cb99c062b80e08fb5fd: Status 404 returned error can't find the container with id c5ef30075b927939fc77043cf0ec7557ae54d0df5aab7cb99c062b80e08fb5fd
Jul 07 19:45:52.133381 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:52.133352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" event={"ID":"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47","Type":"ContainerStarted","Data":"c5ef30075b927939fc77043cf0ec7557ae54d0df5aab7cb99c062b80e08fb5fd"}
Jul 07 19:45:53.139517 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:53.139424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" event={"ID":"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47","Type":"ContainerStarted","Data":"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"}
Jul 07 19:45:53.139517 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:53.139495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:53.161262 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:53.161217    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" podStartSLOduration=1.871439798 podStartE2EDuration="2.161198949s" totalImagesPullingTime="289.759151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:45:53.160416708 +0000 UTC m=+2197.568900314" watchObservedRunningTime="2026-07-07 19:45:53.161198949 +0000 UTC m=+2197.569682503"
Jul 07 19:45:56.156000 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.155970    2570 generic.go:356] "Generic (PLEG): container finished" podID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerID="537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f" exitCode=0
Jul 07 19:45:56.156421 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.156044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerDied","Data":"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"}
Jul 07 19:45:56.156469 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.156427    2570 scope.go:117] "RemoveContainer" containerID="537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"
Jul 07 19:45:56.157438 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.157410    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:56.157529 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.157485    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:56.157570 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:56.157524    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:45:57.074394 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:57.074349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:57.162276 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:57.162240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerStarted","Data":"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"}
Jul 07 19:45:57.716481 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:57.716442    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:45:57.717446 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:57.717406    2570 patch_prober.go:28] interesting pod/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 19:45:57.717600 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:57.717473    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 19:45:58.716301 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:58.716260    2570 patch_prober.go:28] interesting pod/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 19:45:58.716787 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:58.716323    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 19:45:59.155367 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:59.155339    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:45:59.716414 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:59.716371    2570 patch_prober.go:28] interesting pod/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 19:45:59.716920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:45:59.716441    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 19:46:00.716943 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:00.716894    2570 patch_prober.go:28] interesting pod/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 19:46:00.717461 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:00.716990    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 19:46:01.720574 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:01.720540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:46:01.720927 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:01.720818    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:46:01.721659 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:01.721642    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:46:04.204124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.204041    2570 generic.go:356] "Generic (PLEG): container finished" podID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerID="831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516" exitCode=0
Jul 07 19:46:04.204124 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.204076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerDied","Data":"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"}
Jul 07 19:46:04.204512 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.204425    2570 scope.go:117] "RemoveContainer" containerID="831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"
Jul 07 19:46:04.205422 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.205395    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:46:04.205477 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.205460    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:46:04.205514 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:04.205490    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 19:46:05.119718 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:05.119624    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:46:05.214847 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:05.214803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerStarted","Data":"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"}
Jul 07 19:46:05.436030 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:05.435941    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:46:05.437217 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:05.437190    2570 patch_prober.go:28] interesting pod/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 19:46:05.437342 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:05.437238    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 19:46:06.436158 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:06.436127    2570 patch_prober.go:28] interesting pod/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 19:46:06.436538 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:06.436193    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 19:46:07.436759 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:07.436722    2570 patch_prober.go:28] interesting pod/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 19:46:07.437173 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:07.436773    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 19:46:08.436923 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:08.436888    2570 patch_prober.go:28] interesting pod/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 19:46:08.437326 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:08.436939    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 19:46:09.440635 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:09.440602    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:46:09.441072 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:09.440893    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:46:09.441613 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:46:09.441594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:49:16.174294 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:49:16.174258    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:49:16.177844 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:49:16.177818    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:49:16.181629 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:49:16.181612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:49:16.184364 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:49:16.184345    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8klt_0fcb5e02-d137-49ec-9db5-8407b10fd869/ovn-acl-logging/0.log"
Jul 07 19:52:09.119253 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:09.119221    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:52:09.119820 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:09.119429    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy" containerID="cri-o://246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca" gracePeriod=30
Jul 07 19:52:10.300599 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.300562    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:52:10.301007 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.300787    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" podUID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" containerName="maas-api" containerID="cri-o://62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f" gracePeriod=30
Jul 07 19:52:10.547785 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.547752    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:52:10.661424 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.661336    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls\") pod \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") "
Jul 07 19:52:10.661424 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.661374    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdr8z\" (UniqueName: \"kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z\") pod \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") "
Jul 07 19:52:10.661424 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.661392    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca\") pod \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\" (UID: \"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47\") "
Jul 07 19:52:10.661786 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.661764    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" (UID: "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:52:10.663624 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.663598    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" (UID: "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:52:10.663744 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.663718    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z" (OuterVolumeSpecName: "kube-api-access-qdr8z") pod "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" (UID: "6ff3bb6a-a094-4f96-a44c-40b45d6e0f47"). InnerVolumeSpecName "kube-api-access-qdr8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:52:10.761952 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.761917    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-maas-api-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:10.761952 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.761950    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdr8z\" (UniqueName: \"kubernetes.io/projected/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-kube-api-access-qdr8z\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:10.761952 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.761960    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47-openshift-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:10.828753 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.828718    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" containerID="62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f" exitCode=0
Jul 07 19:52:10.828920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.828770    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"
Jul 07 19:52:10.828920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.828790    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" event={"ID":"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47","Type":"ContainerDied","Data":"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"}
Jul 07 19:52:10.828920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.828843    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb" event={"ID":"6ff3bb6a-a094-4f96-a44c-40b45d6e0f47","Type":"ContainerDied","Data":"c5ef30075b927939fc77043cf0ec7557ae54d0df5aab7cb99c062b80e08fb5fd"}
Jul 07 19:52:10.828920 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.828873    2570 scope.go:117] "RemoveContainer" containerID="62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"
Jul 07 19:52:10.840271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.839154    2570 scope.go:117] "RemoveContainer" containerID="62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"
Jul 07 19:52:10.840271 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:52:10.839525    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f\": container with ID starting with 62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f not found: ID does not exist" containerID="62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"
Jul 07 19:52:10.840271 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.839555    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f"} err="failed to get container status \"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f\": rpc error: code = NotFound desc = could not find container \"62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f\": container with ID starting with 62359177447be53d20209dce7fca5a6df932cbd07f2b0d3e094cbdcbecefe74f not found: ID does not exist"
Jul 07 19:52:10.852202 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.852172    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:52:10.858388 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:10.858355    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-0a6be4-79bb545974-tjwlb"]
Jul 07 19:52:12.180879 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:12.180844    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" path="/var/lib/kubelet/pods/6ff3bb6a-a094-4f96-a44c-40b45d6e0f47/volumes"
Jul 07 19:52:14.385931 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.385859    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:52:14.499347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499314    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499347 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499359    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499384    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499425    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499470    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499601 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499578    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499642    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsh9m\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m\") pod \"64e742a1-cbe8-4b61-b319-c31f8404376a\" (UID: \"64e742a1-cbe8-4b61-b319-c31f8404376a\") "
Jul 07 19:52:14.499841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499678    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:14.499841 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499794    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:14.500030 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499917    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:14.500030 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.499944    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:52:14.500201 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.500174    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.500201 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.500194    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.500312 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.500207    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e742a1-cbe8-4b61-b319-c31f8404376a-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.500312 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.500222    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.501146 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.501122    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data" (OuterVolumeSpecName: "istio-data") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:14.502057 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.502028    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m" (OuterVolumeSpecName: "kube-api-access-nsh9m") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "kube-api-access-nsh9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:52:14.502192 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.502121    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:14.502263 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.502245    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:52:14.502302 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.502246    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token" (OuterVolumeSpecName: "istio-token") pod "64e742a1-cbe8-4b61-b319-c31f8404376a" (UID: "64e742a1-cbe8-4b61-b319-c31f8404376a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:52:14.601051 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.601006    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.601230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.601063    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.601230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.601072    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.601230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.601080    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e742a1-cbe8-4b61-b319-c31f8404376a-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.601230 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.601118    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsh9m\" (UniqueName: \"kubernetes.io/projected/64e742a1-cbe8-4b61-b319-c31f8404376a-kube-api-access-nsh9m\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:14.850235 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.850200    2570 generic.go:356] "Generic (PLEG): container finished" podID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerID="246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca" exitCode=0
Jul 07 19:52:14.850399 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.850252    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"
Jul 07 19:52:14.850399 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.850258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerDied","Data":"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"}
Jul 07 19:52:14.850399 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.850380    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth" event={"ID":"64e742a1-cbe8-4b61-b319-c31f8404376a","Type":"ContainerDied","Data":"36a194e552b484990b6143ac11441f37e76d004e40c09d0cde70fea189afd587"}
Jul 07 19:52:14.850537 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.850402    2570 scope.go:117] "RemoveContainer" containerID="246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"
Jul 07 19:52:14.859722 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.859702    2570 scope.go:117] "RemoveContainer" containerID="537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"
Jul 07 19:52:14.867910 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.867888    2570 scope.go:117] "RemoveContainer" containerID="246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"
Jul 07 19:52:14.868245 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:52:14.868222    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca\": container with ID starting with 246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca not found: ID does not exist" containerID="246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"
Jul 07 19:52:14.868318 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.868252    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca"} err="failed to get container status \"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca\": rpc error: code = NotFound desc = could not find container \"246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca\": container with ID starting with 246d2f4919d24785d0613bace17d942bc142527bb26b93890f2bdb2d8c6f7fca not found: ID does not exist"
Jul 07 19:52:14.868318 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.868271    2570 scope.go:117] "RemoveContainer" containerID="537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"
Jul 07 19:52:14.868531 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:52:14.868505    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f\": container with ID starting with 537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f not found: ID does not exist" containerID="537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"
Jul 07 19:52:14.868569 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.868543    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f"} err="failed to get container status \"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f\": rpc error: code = NotFound desc = could not find container \"537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f\": container with ID starting with 537fe0a6cf422d33720cedd5669b4bfd7b6de5f16c6d9df60084611d8df9400f not found: ID does not exist"
Jul 07 19:52:14.874905 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.874873    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:52:14.882732 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:14.882699    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-78237e-openshift-default-5c9d44dcb7-twhth"]
Jul 07 19:52:16.176418 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:16.176383    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" path="/var/lib/kubelet/pods/64e742a1-cbe8-4b61-b319-c31f8404376a/volumes"
Jul 07 19:52:18.403379 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:18.403339    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:52:18.403807 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:18.403543    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy" containerID="cri-o://e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624" gracePeriod=30
Jul 07 19:52:23.650064 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.650038    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:52:23.677824 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.677745    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.677824 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.677793    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.677824 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.677824    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678077 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.677845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678077 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.677954    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678077 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678025    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678077 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678311 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678116    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqkvc\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678311 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678141    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs\") pod \"724bae04-89cd-456f-b8d5-1b5231fca61f\" (UID: \"724bae04-89cd-456f-b8d5-1b5231fca61f\") "
Jul 07 19:52:23.678428 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678331    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:23.678491 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678462    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.678813 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678563    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:23.678813 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.678648    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:23.679202 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.679157    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:52:23.679374 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.679273    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data" (OuterVolumeSpecName: "istio-data") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:23.680928 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.680896    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:52:23.681037 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.680957    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:52:23.681037 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.680968    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token" (OuterVolumeSpecName: "istio-token") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:52:23.681141 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.681100    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc" (OuterVolumeSpecName: "kube-api-access-sqkvc") pod "724bae04-89cd-456f-b8d5-1b5231fca61f" (UID: "724bae04-89cd-456f-b8d5-1b5231fca61f"). InnerVolumeSpecName "kube-api-access-sqkvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:52:23.778853 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778817    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.778853 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778846    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.778853 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778860    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqkvc\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-kube-api-access-sqkvc\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.779128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778873    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.779128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778884    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.779128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778895    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/724bae04-89cd-456f-b8d5-1b5231fca61f-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.779128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778906    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/724bae04-89cd-456f-b8d5-1b5231fca61f-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.779128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.778915    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/724bae04-89cd-456f-b8d5-1b5231fca61f-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\""
Jul 07 19:52:23.894312 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.894272    2570 generic.go:356] "Generic (PLEG): container finished" podID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerID="e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624" exitCode=0
Jul 07 19:52:23.894490 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.894329    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"
Jul 07 19:52:23.894490 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.894353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerDied","Data":"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"}
Jul 07 19:52:23.894490 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.894447    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc" event={"ID":"724bae04-89cd-456f-b8d5-1b5231fca61f","Type":"ContainerDied","Data":"9038c5a050ddc1f450388656bbe8acb4f81475a53d3736707fc712740cafaa94"}
Jul 07 19:52:23.894490 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.894476    2570 scope.go:117] "RemoveContainer" containerID="e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"
Jul 07 19:52:23.903388 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.903369    2570 scope.go:117] "RemoveContainer" containerID="831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"
Jul 07 19:52:23.911146 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.911125    2570 scope.go:117] "RemoveContainer" containerID="e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"
Jul 07 19:52:23.911381 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:52:23.911364    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624\": container with ID starting with e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624 not found: ID does not exist" containerID="e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"
Jul 07 19:52:23.911446 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.911390    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624"} err="failed to get container status \"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624\": rpc error: code = NotFound desc = could not find container \"e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624\": container with ID starting with e95f978ae2cbb1c34f58064b6bad072d65ed4a0b4c135475e48cad719656b624 not found: ID does not exist"
Jul 07 19:52:23.911446 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.911406    2570 scope.go:117] "RemoveContainer" containerID="831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"
Jul 07 19:52:23.911638 ip-10-0-141-105 kubenswrapper[2570]: E0707 19:52:23.911618    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516\": container with ID starting with 831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516 not found: ID does not exist" containerID="831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"
Jul 07 19:52:23.911681 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.911643    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516"} err="failed to get container status \"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516\": rpc error: code = NotFound desc = could not find container \"831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516\": container with ID starting with 831c837d16a7f88ad3ad873a037f33667a97e62f48f96f4d31aee64409299516 not found: ID does not exist"
Jul 07 19:52:23.918066 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.918044    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:52:23.923129 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:23.923107    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-0a6be4-openshift-default-77f94796b7-w5ctc"]
Jul 07 19:52:24.176506 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.176461    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" path="/var/lib/kubelet/pods/724bae04-89cd-456f-b8d5-1b5231fca61f/volumes"
Jul 07 19:52:24.387566 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.387537    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724225-5bvpc_176814b3-eb9b-4dea-a67f-598706d36e6e/cleanup/0.log"
Jul 07 19:52:24.511683 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.511600    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6847f4bd59-4zdhk_1eb834a9-dde8-430a-a924-6a18e6f04faa/manager/0.log"
Jul 07 19:52:24.631927 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.631898    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pdpq6_64b3f58d-49ee-4bf7-97e2-e2bd2d55b949/server/0.log"
Jul 07 19:52:24.872297 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.872272    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75847b84df-48v24_bdcc172d-4023-4480-a345-bdd579827227/copy-manifests/0.log"
Jul 07 19:52:24.886520 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:24.886490    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75847b84df-48v24_bdcc172d-4023-4480-a345-bdd579827227/manager/0.log"
Jul 07 19:52:25.255494 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:25.255404    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d8m86_677ab0f9-6e57-4114-bf53-2e63a545dbd3/postgres/0.log"
Jul 07 19:52:27.803930 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:27.803899    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bb29j_6622b669-8749-4a35-99d7-3dbb0cd6d93a/discovery/0.log"
Jul 07 19:52:28.259795 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:28.259717    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9rvwr_ee030528-7971-4129-a073-3d4c1f95d1e9/payload-pre-processing/0.log"
Jul 07 19:52:28.482399 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:28.482368    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5778f4bf5f-tc7v6_21344326-6e4b-477a-b0bf-057cffd22fd2/router/0.log"
Jul 07 19:52:28.941216 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:28.941186    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cmcvh_da38064c-b6cb-45af-84a8-d7fd468c8514/main/0.log"
Jul 07 19:52:29.158040 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:29.158012    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqj764_2a7ab379-3b6e-4981-a038-1b371d58d8bf/main/0.log"
Jul 07 19:52:36.584993 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:36.584913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t6zhx_5eb6a5d3-d7b8-4bf5-b82f-58a9fccf7133/global-pull-secret-syncer/0.log"
Jul 07 19:52:36.725907 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:36.725876    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-skf95_3ba88fc5-d147-4b2d-8b04-92273cba6d67/konnectivity-agent/0.log"
Jul 07 19:52:36.816856 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:36.816825    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-105.ec2.internal_2b912bebfdf89ae599c4f63a8166d7eb/haproxy/0.log"
Jul 07 19:52:45.116324 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:45.116289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz7dk_b4e13868-6f0d-4d6c-91c0-38c61d4e5e37/node-exporter/0.log"
Jul 07 19:52:45.142910 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:45.142879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz7dk_b4e13868-6f0d-4d6c-91c0-38c61d4e5e37/kube-rbac-proxy/0.log"
Jul 07 19:52:45.172398 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:45.172371    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kz7dk_b4e13868-6f0d-4d6c-91c0-38c61d4e5e37/init-textfile/0.log"
Jul 07 19:52:46.717768 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.717734    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"]
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718059    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718071    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718108    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718114    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718123    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718128    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718138    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" containerName="maas-api"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718143    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" containerName="maas-api"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718149    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718163 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718155    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718217    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e742a1-cbe8-4b61-b319-c31f8404376a" containerName="istio-proxy"
Jul 07 19:52:46.718525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718225    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718231    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="724bae04-89cd-456f-b8d5-1b5231fca61f" containerName="istio-proxy"
Jul 07 19:52:46.718525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.718236    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff3bb6a-a094-4f96-a44c-40b45d6e0f47" containerName="maas-api"
Jul 07 19:52:46.722783 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.722759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.725471 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.725449    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j2nl9\"/\"openshift-service-ca.crt\""
Jul 07 19:52:46.725610 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.725486    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j2nl9\"/\"default-dockercfg-qqkct\""
Jul 07 19:52:46.726678 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.726657    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j2nl9\"/\"kube-root-ca.crt\""
Jul 07 19:52:46.730958 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.730936    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"]
Jul 07 19:52:46.760428 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.760386    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-sys\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.760612 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.760438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-proc\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.760612 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.760559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blshm\" (UniqueName: \"kubernetes.io/projected/e10cdc05-6362-47b3-8bb7-3c2b46796b03-kube-api-access-blshm\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.760612 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.760608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-lib-modules\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.760724 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.760625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-podres\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.861630 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blshm\" (UniqueName: \"kubernetes.io/projected/e10cdc05-6362-47b3-8bb7-3c2b46796b03-kube-api-access-blshm\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.861809 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-lib-modules\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.861809 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-podres\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.861809 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-sys\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.861809 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-proc\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.862017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861850    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-lib-modules\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.862017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861853    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-podres\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.862017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861862    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-proc\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.862017 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.861875    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10cdc05-6362-47b3-8bb7-3c2b46796b03-sys\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:46.871261 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:46.871232    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blshm\" (UniqueName: \"kubernetes.io/projected/e10cdc05-6362-47b3-8bb7-3c2b46796b03-kube-api-access-blshm\") pod \"perf-node-gather-daemonset-blgpf\" (UID: \"e10cdc05-6362-47b3-8bb7-3c2b46796b03\") " pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:47.033051 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:47.032948    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:47.176898 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:47.176869    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"]
Jul 07 19:52:47.178975 ip-10-0-141-105 kubenswrapper[2570]: W0707 19:52:47.178946    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode10cdc05_6362_47b3_8bb7_3c2b46796b03.slice/crio-1779850515aa7485a60613b1ddce8cbbec66d011bfa136ef677ea97cd403d3e5 WatchSource:0}: Error finding container 1779850515aa7485a60613b1ddce8cbbec66d011bfa136ef677ea97cd403d3e5: Status 404 returned error can't find the container with id 1779850515aa7485a60613b1ddce8cbbec66d011bfa136ef677ea97cd403d3e5
Jul 07 19:52:47.733657 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:47.733576    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/1.log"
Jul 07 19:52:47.738226 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:47.738205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lj5pj_27eb14a8-7d67-4b52-9bda-7563eeb540dd/console-operator/2.log"
Jul 07 19:52:48.003521 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:48.003426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf" event={"ID":"e10cdc05-6362-47b3-8bb7-3c2b46796b03","Type":"ContainerStarted","Data":"a79108adac1b1d876a51ec7ff0483f9028b707783b474e6622999e71b4d50f04"}
Jul 07 19:52:48.003521 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:48.003506    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf" event={"ID":"e10cdc05-6362-47b3-8bb7-3c2b46796b03","Type":"ContainerStarted","Data":"1779850515aa7485a60613b1ddce8cbbec66d011bfa136ef677ea97cd403d3e5"}
Jul 07 19:52:48.003709 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:48.003555    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:48.023005 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:48.022953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf" podStartSLOduration=2.02293836 podStartE2EDuration="2.02293836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:52:48.022470327 +0000 UTC m=+2612.430953885" watchObservedRunningTime="2026-07-07 19:52:48.02293836 +0000 UTC m=+2612.431421924"
Jul 07 19:52:50.062404 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:50.062379    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fz7zv_962359a9-367b-4f83-b5d5-6452d8e5829f/dns/0.log"
Jul 07 19:52:50.091892 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:50.091846    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fz7zv_962359a9-367b-4f83-b5d5-6452d8e5829f/kube-rbac-proxy/0.log"
Jul 07 19:52:50.242506 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:50.242478    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2mvtb_23fb7830-95a8-4031-b436-94b478b9cb49/dns-node-resolver/0.log"
Jul 07 19:52:50.942793 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:50.942767    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrqh_67b36354-451a-486b-b945-74a9275c8fef/node-ca/0.log"
Jul 07 19:52:52.215236 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:52.215199    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bb29j_6622b669-8749-4a35-99d7-3dbb0cd6d93a/discovery/0.log"
Jul 07 19:52:52.382462 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:52.382427    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9rvwr_ee030528-7971-4129-a073-3d4c1f95d1e9/payload-pre-processing/0.log"
Jul 07 19:52:52.461395 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:52.461370    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5778f4bf5f-tc7v6_21344326-6e4b-477a-b0bf-057cffd22fd2/router/0.log"
Jul 07 19:52:53.243134 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:53.243104    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqrqp_80134ed4-728d-435e-a083-fb2a49ffb909/serve-healthcheck-canary/0.log"
Jul 07 19:52:53.975333 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:53.975304    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l645h_3351daee-222c-47dc-ad60-a89042824694/kube-rbac-proxy/0.log"
Jul 07 19:52:54.009359 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:54.009331    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l645h_3351daee-222c-47dc-ad60-a89042824694/exporter/0.log"
Jul 07 19:52:54.017745 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:54.017721    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j2nl9/perf-node-gather-daemonset-blgpf"
Jul 07 19:52:54.050363 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:54.050324    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l645h_3351daee-222c-47dc-ad60-a89042824694/extractor/0.log"
Jul 07 19:52:56.950252 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:56.950178    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724225-5bvpc_176814b3-eb9b-4dea-a67f-598706d36e6e/cleanup/0.log"
Jul 07 19:52:57.065961 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.065929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6847f4bd59-4zdhk_1eb834a9-dde8-430a-a924-6a18e6f04faa/manager/0.log"
Jul 07 19:52:57.093067 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.093042    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pdpq6_64b3f58d-49ee-4bf7-97e2-e2bd2d55b949/server/0.log"
Jul 07 19:52:57.266758 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.266678    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75847b84df-48v24_bdcc172d-4023-4480-a345-bdd579827227/manager/0.log"
Jul 07 19:52:57.298074 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.298051    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75847b84df-48v24_bdcc172d-4023-4480-a345-bdd579827227/copy-manifests/0.log"
Jul 07 19:52:57.431128 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.431073    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bb29j_6622b669-8749-4a35-99d7-3dbb0cd6d93a/discovery/0.log"
Jul 07 19:52:57.469056 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.469030    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d8m86_677ab0f9-6e57-4114-bf53-2e63a545dbd3/postgres/0.log"
Jul 07 19:52:57.557398 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.557377    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9rvwr_ee030528-7971-4129-a073-3d4c1f95d1e9/payload-pre-processing/0.log"
Jul 07 19:52:57.620697 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:57.620667    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5778f4bf5f-tc7v6_21344326-6e4b-477a-b0bf-057cffd22fd2/router/0.log"
Jul 07 19:52:58.974525 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:58.974492    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76668d465c-bvrqb_90e2a457-45ed-48ac-bdeb-cc24230aaa5b/manager/0.log"
Jul 07 19:52:59.117312 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:59.117276    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bb29j_6622b669-8749-4a35-99d7-3dbb0cd6d93a/discovery/0.log"
Jul 07 19:52:59.249244 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:59.249146    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9rvwr_ee030528-7971-4129-a073-3d4c1f95d1e9/payload-pre-processing/0.log"
Jul 07 19:52:59.304799 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:52:59.304767    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5778f4bf5f-tc7v6_21344326-6e4b-477a-b0bf-057cffd22fd2/router/0.log"
Jul 07 19:53:04.355461 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:53:04.355425    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bbdtc_99b53441-6f56-484f-bc81-a82f1d50af5e/migrator/0.log"
Jul 07 19:53:04.389905 ip-10-0-141-105 kubenswrapper[2570]: I0707 19:53:04.389873    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bbdtc_99b53441-6f56-484f-bc81-a82f1d50af5e/graceful-termination/0.log"